2023-07-15 19:06:26,012 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3 2023-07-15 19:06:26,031 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestAdmin1 timeout: 13 mins 2023-07-15 19:06:26,047 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 19:06:26,047 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549, deleteOnExit=true 2023-07-15 19:06:26,048 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 19:06:26,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/test.cache.data in system properties and HBase conf 2023-07-15 19:06:26,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 19:06:26,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/hadoop.log.dir in system properties and HBase conf 2023-07-15 19:06:26,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 19:06:26,050 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 19:06:26,050 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 19:06:26,169 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 19:06:26,540 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 19:06:26,544 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 19:06:26,545 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 19:06:26,545 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 19:06:26,546 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 19:06:26,546 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 19:06:26,546 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 19:06:26,546 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 19:06:26,547 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 19:06:26,547 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 19:06:26,548 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/nfs.dump.dir in system properties and HBase conf 2023-07-15 19:06:26,548 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/java.io.tmpdir in system properties and HBase conf 2023-07-15 19:06:26,549 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 19:06:26,549 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 19:06:26,550 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 19:06:27,176 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 19:06:27,181 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 19:06:27,521 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 19:06:27,764 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 19:06:27,784 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 19:06:27,827 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 19:06:27,866 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/java.io.tmpdir/Jetty_localhost_44699_hdfs____2ow7pc/webapp 2023-07-15 19:06:28,079 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44699 2023-07-15 19:06:28,092 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 19:06:28,093 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 19:06:28,510 WARN [Listener at localhost/38943] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 19:06:28,620 WARN [Listener at localhost/38943] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 19:06:28,638 WARN [Listener at localhost/38943] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 19:06:28,643 INFO [Listener at localhost/38943] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 19:06:28,649 INFO [Listener at localhost/38943] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/java.io.tmpdir/Jetty_localhost_41459_datanode____iy5iua/webapp 2023-07-15 19:06:28,744 INFO [Listener at localhost/38943] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41459 2023-07-15 19:06:29,045 WARN [Listener at localhost/46763] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 19:06:29,056 WARN [Listener at localhost/46763] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 19:06:29,059 WARN [Listener at localhost/46763] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 19:06:29,062 INFO [Listener at localhost/46763] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 19:06:29,068 INFO [Listener at localhost/46763] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/java.io.tmpdir/Jetty_localhost_35061_datanode____.zg1lxs/webapp 2023-07-15 19:06:29,179 INFO [Listener at localhost/46763] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35061 2023-07-15 19:06:29,197 WARN [Listener at localhost/46359] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 19:06:29,230 WARN [Listener at localhost/46359] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 19:06:29,233 WARN [Listener at localhost/46359] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 19:06:29,235 INFO [Listener at localhost/46359] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 19:06:29,245 INFO [Listener at localhost/46359] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/java.io.tmpdir/Jetty_localhost_44307_datanode____k72kf5/webapp 2023-07-15 19:06:29,370 INFO [Listener at localhost/46359] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44307 2023-07-15 19:06:29,382 WARN [Listener at localhost/45529] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 19:06:29,591 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38b144f88bf19b0b: Processing first storage report for DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13 from datanode 4dc9e269-177d-4e3e-aab5-02c1ab07e254 2023-07-15 19:06:29,593 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38b144f88bf19b0b: from storage DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13 node DatanodeRegistration(127.0.0.1:38603, datanodeUuid=4dc9e269-177d-4e3e-aab5-02c1ab07e254, infoPort=35873, infoSecurePort=0, ipcPort=46359, storageInfo=lv=-57;cid=testClusterID;nsid=727727320;c=1689447987257), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 19:06:29,594 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbb69d1060c7cf5b1: Processing first storage report for DS-8c742b49-9470-473e-b584-ba6045789e33 from datanode 71de83e6-e4cd-4796-9d0e-35edc6cf495f 2023-07-15 19:06:29,594 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbb69d1060c7cf5b1: from storage DS-8c742b49-9470-473e-b584-ba6045789e33 node DatanodeRegistration(127.0.0.1:38991, datanodeUuid=71de83e6-e4cd-4796-9d0e-35edc6cf495f, infoPort=45103, infoSecurePort=0, ipcPort=45529, storageInfo=lv=-57;cid=testClusterID;nsid=727727320;c=1689447987257), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 19:06:29,594 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd6557ff829669f5: Processing first storage report for DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe from datanode 787371eb-efe3-4cd5-9440-0f165e59ce52 2023-07-15 19:06:29,594 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd6557ff829669f5: from storage DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe node DatanodeRegistration(127.0.0.1:41319, datanodeUuid=787371eb-efe3-4cd5-9440-0f165e59ce52, infoPort=34371, infoSecurePort=0, ipcPort=46763, storageInfo=lv=-57;cid=testClusterID;nsid=727727320;c=1689447987257), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 19:06:29,594 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38b144f88bf19b0b: Processing first storage report for DS-ee862810-f3e4-4d04-bd1d-b3bf1847d522 from datanode 4dc9e269-177d-4e3e-aab5-02c1ab07e254 2023-07-15 19:06:29,595 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38b144f88bf19b0b: from storage DS-ee862810-f3e4-4d04-bd1d-b3bf1847d522 node DatanodeRegistration(127.0.0.1:38603, datanodeUuid=4dc9e269-177d-4e3e-aab5-02c1ab07e254, infoPort=35873, infoSecurePort=0, ipcPort=46359, storageInfo=lv=-57;cid=testClusterID;nsid=727727320;c=1689447987257), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 19:06:29,595 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbb69d1060c7cf5b1: Processing first storage report for DS-b192beee-8372-4cbc-a9d6-c3cd05fc9bfb from datanode 71de83e6-e4cd-4796-9d0e-35edc6cf495f 2023-07-15 19:06:29,595 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbb69d1060c7cf5b1: from storage DS-b192beee-8372-4cbc-a9d6-c3cd05fc9bfb node DatanodeRegistration(127.0.0.1:38991, datanodeUuid=71de83e6-e4cd-4796-9d0e-35edc6cf495f, infoPort=45103, infoSecurePort=0, ipcPort=45529, storageInfo=lv=-57;cid=testClusterID;nsid=727727320;c=1689447987257), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 19:06:29,595 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd6557ff829669f5: Processing first storage report for DS-916aaeef-4c1c-4772-a1f5-a7dbb872c04f from datanode 787371eb-efe3-4cd5-9440-0f165e59ce52 2023-07-15 19:06:29,595 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd6557ff829669f5: from storage DS-916aaeef-4c1c-4772-a1f5-a7dbb872c04f node DatanodeRegistration(127.0.0.1:41319, datanodeUuid=787371eb-efe3-4cd5-9440-0f165e59ce52, infoPort=34371, infoSecurePort=0, ipcPort=46763, storageInfo=lv=-57;cid=testClusterID;nsid=727727320;c=1689447987257), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 19:06:29,809 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3 2023-07-15 19:06:29,871 INFO [Listener at localhost/45529] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/zookeeper_0, clientPort=56639, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 19:06:29,888 INFO [Listener at localhost/45529] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56639 2023-07-15 19:06:29,899 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:29,902 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:30,560 INFO [Listener at localhost/45529] util.FSUtils(471): Created version file at hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879 with version=8 2023-07-15 19:06:30,560 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/hbase-staging 2023-07-15 19:06:30,875 INFO [Listener at localhost/45529] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 19:06:31,358 INFO [Listener at localhost/45529] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=18 2023-07-15 19:06:31,392 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2023-07-15 19:06:31,393 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2023-07-15 19:06:31,393 INFO [Listener at localhost/45529] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=3 readQueues=2 readHandlers=27 scanQueues=0 scanHandlers=0 2023-07-15 19:06:31,393 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2023-07-15 19:06:31,393 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=1 2023-07-15 19:06:31,538 INFO [Listener at localhost/45529] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 19:06:31,636 DEBUG [Listener at localhost/45529] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 19:06:31,730 INFO [Listener at localhost/45529] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46803 2023-07-15 19:06:31,740 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:31,742 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:31,762 INFO [Listener at localhost/45529] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46803 connecting to ZooKeeper ensemble=127.0.0.1:56639 2023-07-15 19:06:31,805 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:468030x0, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 19:06:31,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46803-0x1016a6105630000 connected 2023-07-15 19:06:31,834 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 19:06:31,835 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 19:06:31,838 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 19:06:31,848 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=46803 2023-07-15 19:06:31,849 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46803 2023-07-15 19:06:31,852 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=30 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=2, port=46803 2023-07-15 19:06:31,852 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46803 2023-07-15 19:06:31,853 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46803 2023-07-15 19:06:31,859 INFO [Listener at localhost/45529] master.HMaster(444): hbase.rootdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879, hbase.cluster.distributed=false 2023-07-15 19:06:31,952 INFO [Listener at localhost/45529] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=18 2023-07-15 19:06:31,953 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2023-07-15 19:06:31,953 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2023-07-15 19:06:31,954 INFO [Listener at localhost/45529] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=3 readQueues=2 readHandlers=27 scanQueues=0 scanHandlers=0 2023-07-15 19:06:31,954 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2023-07-15 19:06:31,954 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=1 2023-07-15 19:06:31,959 INFO [Listener at localhost/45529] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 19:06:31,962 INFO [Listener at localhost/45529] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42361 2023-07-15 19:06:31,964 INFO [Listener at localhost/45529] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 19:06:31,970 DEBUG [Listener at localhost/45529] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 19:06:31,971 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:31,973 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:31,974 INFO [Listener at localhost/45529] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42361 connecting to ZooKeeper ensemble=127.0.0.1:56639 2023-07-15 19:06:31,977 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:423610x0, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 19:06:31,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42361-0x1016a6105630001 connected 2023-07-15 19:06:31,979 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 19:06:31,980 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 19:06:31,981 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 19:06:31,985 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=42361 2023-07-15 19:06:31,985 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42361 2023-07-15 19:06:31,988 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=30 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=2, port=42361 2023-07-15 19:06:31,988 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42361 2023-07-15 19:06:31,989 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42361 2023-07-15 19:06:32,001 INFO [Listener at localhost/45529] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=18 2023-07-15 19:06:32,002 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2023-07-15 19:06:32,002 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2023-07-15 19:06:32,002 INFO [Listener at localhost/45529] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=3 readQueues=2 readHandlers=27 scanQueues=0 scanHandlers=0 2023-07-15 19:06:32,002 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2023-07-15 19:06:32,002 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=1 2023-07-15 19:06:32,002 INFO [Listener at localhost/45529] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 19:06:32,004 INFO [Listener at localhost/45529] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36223 2023-07-15 19:06:32,004 INFO [Listener at localhost/45529] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 19:06:32,006 DEBUG [Listener at localhost/45529] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 19:06:32,006 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:32,008 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:32,011 INFO [Listener at localhost/45529] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36223 connecting to ZooKeeper ensemble=127.0.0.1:56639 2023-07-15 19:06:32,015 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:362230x0, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 19:06:32,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36223-0x1016a6105630002 connected 2023-07-15 19:06:32,016 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 19:06:32,017 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 19:06:32,018 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 19:06:32,022 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=36223 2023-07-15 19:06:32,022 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36223 2023-07-15 19:06:32,025 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=30 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=2, port=36223 2023-07-15 19:06:32,025 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36223 2023-07-15 19:06:32,026 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36223 2023-07-15 19:06:32,038 INFO [Listener at localhost/45529] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=18 2023-07-15 19:06:32,038 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2023-07-15 19:06:32,039 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2023-07-15 19:06:32,039 INFO [Listener at localhost/45529] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=3 readQueues=2 readHandlers=27 scanQueues=0 scanHandlers=0 2023-07-15 19:06:32,039 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2023-07-15 19:06:32,039 INFO [Listener at localhost/45529] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=1 2023-07-15 19:06:32,039 INFO [Listener at localhost/45529] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 19:06:32,041 INFO [Listener at localhost/45529] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42217 2023-07-15 19:06:32,042 INFO [Listener at localhost/45529] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 19:06:32,043 DEBUG [Listener at localhost/45529] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 19:06:32,045 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:32,046 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:32,047 INFO [Listener at localhost/45529] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42217 connecting to ZooKeeper ensemble=127.0.0.1:56639 2023-07-15 19:06:32,051 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:422170x0, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 19:06:32,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42217-0x1016a6105630003 connected 2023-07-15 19:06:32,052 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 19:06:32,053 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 19:06:32,054 DEBUG [Listener at localhost/45529] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 19:06:32,056 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=42217 2023-07-15 19:06:32,057 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42217 2023-07-15 19:06:32,059 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=30 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=2, port=42217 2023-07-15 19:06:32,060 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42217 2023-07-15 19:06:32,060 DEBUG [Listener at localhost/45529] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42217 2023-07-15 19:06:32,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:06:32,071 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 19:06:32,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:06:32,090 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 19:06:32,090 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 19:06:32,090 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 19:06:32,090 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 19:06:32,091 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:06:32,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 19:06:32,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46803,1689447990709 from backup master directory 2023-07-15 19:06:32,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 19:06:32,100 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:06:32,100 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 19:06:32,101 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 19:06:32,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:06:32,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 19:06:32,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 19:06:32,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/hbase.id with ID: 7e1e0829-0983-49ae-a7b9-0b212513fff4 2023-07-15 19:06:32,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:06:32,262 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:06:32,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x08166d59 to 127.0.0.1:56639 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 19:06:32,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@286e03e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 19:06:32,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:32,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 19:06:32,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 19:06:32,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 19:06:32,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 19:06:32,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 19:06:32,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 19:06:32,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store-tmp 2023-07-15 19:06:32,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:32,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 19:06:32,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 19:06:32,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 19:06:32,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 19:06:32,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 19:06:32,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 19:06:32,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 19:06:32,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/WALs/jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:06:32,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46803%2C1689447990709, suffix=, logDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/WALs/jenkins-hbase4.apache.org,46803,1689447990709, archiveDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/oldWALs, maxLogs=10 2023-07-15 19:06:32,636 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK] 2023-07-15 19:06:32,637 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK] 2023-07-15 19:06:32,636 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK] 2023-07-15 19:06:32,645 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 19:06:32,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/WALs/jenkins-hbase4.apache.org,46803,1689447990709/jenkins-hbase4.apache.org%2C46803%2C1689447990709.1689447992571 2023-07-15 19:06:32,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK], DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK], DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK]] 2023-07-15 19:06:32,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:32,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:32,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 19:06:32,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 19:06:32,787 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 19:06:32,794 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 19:06:32,818 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 19:06:32,829 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:32,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 19:06:32,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 19:06:32,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 19:06:32,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:32,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61303303, jitterRate=-0.0865096002817154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:32,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 19:06:32,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 19:06:32,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 19:06:32,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 19:06:32,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 19:06:32,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 19:06:32,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-07-15 19:06:32,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 19:06:32,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 19:06:32,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 19:06:32,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 19:06:32,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 19:06:32,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 19:06:32,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 19:06:32,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 19:06:32,987 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:06:32,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 19:06:32,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 19:06:33,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 19:06:33,006 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 19:06:33,006 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 19:06:33,006 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 19:06:33,006 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 19:06:33,006 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:06:33,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46803,1689447990709, sessionid=0x1016a6105630000, setting cluster-up flag (Was=false) 2023-07-15 19:06:33,027 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:06:33,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 19:06:33,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:06:33,045 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:06:33,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 19:06:33,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:06:33,056 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.hbase-snapshot/.tmp 2023-07-15 19:06:33,063 INFO [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(951): ClusterId : 7e1e0829-0983-49ae-a7b9-0b212513fff4 2023-07-15 19:06:33,063 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(951): ClusterId : 7e1e0829-0983-49ae-a7b9-0b212513fff4 2023-07-15 19:06:33,063 INFO [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(951): ClusterId : 7e1e0829-0983-49ae-a7b9-0b212513fff4 2023-07-15 19:06:33,069 DEBUG [RS:1;jenkins-hbase4:36223] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 19:06:33,069 DEBUG [RS:2;jenkins-hbase4:42217] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 19:06:33,069 DEBUG [RS:0;jenkins-hbase4:42361] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 19:06:33,076 DEBUG [RS:2;jenkins-hbase4:42217] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 19:06:33,076 DEBUG [RS:0;jenkins-hbase4:42361] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 19:06:33,076 DEBUG [RS:1;jenkins-hbase4:36223] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 19:06:33,076 DEBUG [RS:0;jenkins-hbase4:42361] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 19:06:33,076 DEBUG [RS:2;jenkins-hbase4:42217] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 19:06:33,076 DEBUG [RS:1;jenkins-hbase4:36223] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 19:06:33,080 DEBUG [RS:0;jenkins-hbase4:42361] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 19:06:33,081 DEBUG [RS:2;jenkins-hbase4:42217] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 19:06:33,082 DEBUG [RS:1;jenkins-hbase4:36223] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 19:06:33,084 DEBUG [RS:2;jenkins-hbase4:42217] zookeeper.ReadOnlyZKClient(139): Connect 0x3f4290a1 to 127.0.0.1:56639 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 19:06:33,085 DEBUG [RS:1;jenkins-hbase4:36223] zookeeper.ReadOnlyZKClient(139): Connect 0x7ac1e54a to 127.0.0.1:56639 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 19:06:33,084 DEBUG [RS:0;jenkins-hbase4:42361] zookeeper.ReadOnlyZKClient(139): Connect 0x61706be8 to 127.0.0.1:56639 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 19:06:33,095 DEBUG [RS:2;jenkins-hbase4:42217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31856939, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 19:06:33,095 DEBUG [RS:1;jenkins-hbase4:36223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74060462, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 19:06:33,095 DEBUG [RS:0;jenkins-hbase4:42361] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb789b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 19:06:33,096 DEBUG [RS:2;jenkins-hbase4:42217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35bafbd1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 19:06:33,096 DEBUG [RS:1;jenkins-hbase4:36223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70398e3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 19:06:33,096 DEBUG [RS:0;jenkins-hbase4:42361] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b880098, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 19:06:33,119 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42361 2023-07-15 19:06:33,119 DEBUG [RS:2;jenkins-hbase4:42217] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42217 2023-07-15 19:06:33,123 INFO [RS:0;jenkins-hbase4:42361] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 19:06:33,124 INFO [RS:0;jenkins-hbase4:42361] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 19:06:33,123 INFO [RS:2;jenkins-hbase4:42217] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 19:06:33,124 INFO [RS:2;jenkins-hbase4:42217] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 19:06:33,124 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 19:06:33,124 DEBUG [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 19:06:33,125 DEBUG [RS:1;jenkins-hbase4:36223] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36223 2023-07-15 19:06:33,125 INFO [RS:1;jenkins-hbase4:36223] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 19:06:33,125 INFO [RS:1;jenkins-hbase4:36223] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 19:06:33,125 DEBUG [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 19:06:33,127 INFO [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46803,1689447990709 with isa=jenkins-hbase4.apache.org/172.31.14.131:36223, startcode=1689447992001 2023-07-15 19:06:33,127 INFO [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46803,1689447990709 with isa=jenkins-hbase4.apache.org/172.31.14.131:42217, startcode=1689447992037 2023-07-15 19:06:33,127 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46803,1689447990709 with isa=jenkins-hbase4.apache.org/172.31.14.131:42361, startcode=1689447991925 2023-07-15 19:06:33,147 DEBUG [RS:1;jenkins-hbase4:36223] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 19:06:33,147 DEBUG [RS:2;jenkins-hbase4:42217] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 19:06:33,147 DEBUG [RS:0;jenkins-hbase4:42361] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 19:06:33,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 19:06:33,207 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41775, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 19:06:33,207 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51279, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 19:06:33,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 19:06:33,207 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60303, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 19:06:33,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 19:06:33,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 19:06:33,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 19:06:33,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 19:06:33,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 19:06:33,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689448023210 2023-07-15 19:06:33,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 19:06:33,217 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 19:06:33,218 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=1,queue=0,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:06:33,220 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 19:06:33,218 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=2,queue=0,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:06:33,218 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:06:33,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 19:06:33,226 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:33,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 19:06:33,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 19:06:33,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 19:06:33,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 19:06:33,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 19:06:33,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 19:06:33,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 19:06:33,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 19:06:33,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 19:06:33,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689447993244,5,FailOnTimeoutGroup] 2023-07-15 19:06:33,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689447993244,5,FailOnTimeoutGroup] 2023-07-15 19:06:33,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 19:06:33,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,253 DEBUG [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 19:06:33,253 DEBUG [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 19:06:33,253 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 19:06:33,254 WARN [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 19:06:33,254 WARN [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 19:06:33,254 WARN [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 19:06:33,271 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:33,272 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:33,273 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879 2023-07-15 19:06:33,297 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:33,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 19:06:33,302 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/info 2023-07-15 19:06:33,303 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 19:06:33,303 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:33,304 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 19:06:33,306 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/rep_barrier 2023-07-15 19:06:33,307 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 19:06:33,307 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:33,308 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 19:06:33,310 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/table 2023-07-15 19:06:33,310 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 19:06:33,311 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:33,312 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740 2023-07-15 19:06:33,313 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740 2023-07-15 19:06:33,317 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 19:06:33,319 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 19:06:33,322 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:33,323 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71776108, jitterRate=0.06954735517501831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 19:06:33,323 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 19:06:33,323 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 19:06:33,323 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 19:06:33,323 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 19:06:33,323 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 19:06:33,323 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 19:06:33,327 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 19:06:33,327 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 19:06:33,333 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 19:06:33,333 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 19:06:33,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 19:06:33,353 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 19:06:33,355 INFO [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46803,1689447990709 with isa=jenkins-hbase4.apache.org/172.31.14.131:42217, startcode=1689447992037 2023-07-15 19:06:33,356 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46803,1689447990709 with isa=jenkins-hbase4.apache.org/172.31.14.131:42361, startcode=1689447991925 2023-07-15 19:06:33,356 INFO [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46803,1689447990709 with isa=jenkins-hbase4.apache.org/172.31.14.131:36223, startcode=1689447992001 2023-07-15 19:06:33,358 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 19:06:33,362 INFO [RpcServer.priority.RWQ.Fifo.write.handler=2,queue=0,port=46803] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:33,363 INFO [RpcServer.priority.RWQ.Fifo.write.handler=1,queue=0,port=46803] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:33,364 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46803] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,370 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879 2023-07-15 19:06:33,370 DEBUG [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879 2023-07-15 19:06:33,370 DEBUG [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879 2023-07-15 19:06:33,371 DEBUG [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38943 2023-07-15 19:06:33,371 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38943 2023-07-15 19:06:33,371 DEBUG [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 19:06:33,371 DEBUG [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38943 2023-07-15 19:06:33,371 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 19:06:33,371 DEBUG [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 19:06:33,381 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 19:06:33,381 DEBUG [RS:1;jenkins-hbase4:36223] zookeeper.ZKUtil(162): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:33,381 DEBUG [RS:0;jenkins-hbase4:42361] zookeeper.ZKUtil(162): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,381 WARN [RS:1;jenkins-hbase4:36223] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 19:06:33,381 DEBUG [RS:2;jenkins-hbase4:42217] zookeeper.ZKUtil(162): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:33,382 INFO [RS:1;jenkins-hbase4:36223] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 19:06:33,381 WARN [RS:0;jenkins-hbase4:42361] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 19:06:33,383 DEBUG [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:33,383 INFO [RS:0;jenkins-hbase4:42361] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 19:06:33,382 WARN [RS:2;jenkins-hbase4:42217] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 19:06:33,383 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,383 INFO [RS:2;jenkins-hbase4:42217] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 19:06:33,383 DEBUG [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:33,384 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36223,1689447992001] 2023-07-15 19:06:33,384 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42361,1689447991925] 2023-07-15 19:06:33,384 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42217,1689447992037] 2023-07-15 19:06:33,399 DEBUG [RS:1;jenkins-hbase4:36223] zookeeper.ZKUtil(162): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:33,399 DEBUG [RS:2;jenkins-hbase4:42217] zookeeper.ZKUtil(162): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:33,399 DEBUG [RS:0;jenkins-hbase4:42361] zookeeper.ZKUtil(162): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:33,399 DEBUG [RS:1;jenkins-hbase4:36223] zookeeper.ZKUtil(162): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,399 DEBUG [RS:2;jenkins-hbase4:42217] zookeeper.ZKUtil(162): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,399 DEBUG [RS:0;jenkins-hbase4:42361] zookeeper.ZKUtil(162): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,400 DEBUG [RS:1;jenkins-hbase4:36223] zookeeper.ZKUtil(162): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:33,400 DEBUG [RS:2;jenkins-hbase4:42217] zookeeper.ZKUtil(162): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:33,400 DEBUG [RS:0;jenkins-hbase4:42361] zookeeper.ZKUtil(162): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:33,410 DEBUG [RS:1;jenkins-hbase4:36223] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 19:06:33,410 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 19:06:33,410 DEBUG [RS:2;jenkins-hbase4:42217] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 19:06:33,419 INFO [RS:1;jenkins-hbase4:36223] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 19:06:33,419 INFO [RS:0;jenkins-hbase4:42361] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 19:06:33,419 INFO [RS:2;jenkins-hbase4:42217] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 19:06:33,443 INFO [RS:1;jenkins-hbase4:36223] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 19:06:33,443 INFO [RS:0;jenkins-hbase4:42361] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 19:06:33,443 INFO [RS:2;jenkins-hbase4:42217] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 19:06:33,448 INFO [RS:0;jenkins-hbase4:42361] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 19:06:33,448 INFO [RS:2;jenkins-hbase4:42217] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 19:06:33,448 INFO [RS:1;jenkins-hbase4:36223] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 19:06:33,449 INFO [RS:2;jenkins-hbase4:42217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,449 INFO [RS:0;jenkins-hbase4:42361] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,449 INFO [RS:1;jenkins-hbase4:36223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,450 INFO [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 19:06:33,451 INFO [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 19:06:33,450 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 19:06:33,460 INFO [RS:0;jenkins-hbase4:42361] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,460 INFO [RS:2;jenkins-hbase4:42217] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,460 INFO [RS:1;jenkins-hbase4:36223] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,460 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,461 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,460 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,461 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,461 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,461 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,461 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 19:06:33,462 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 19:06:33,462 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,462 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 19:06:33,463 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:2;jenkins-hbase4:42217] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:1;jenkins-hbase4:36223] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,463 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,464 DEBUG [RS:0;jenkins-hbase4:42361] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 19:06:33,465 INFO [RS:0;jenkins-hbase4:42361] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,465 INFO [RS:0;jenkins-hbase4:42361] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,465 INFO [RS:0;jenkins-hbase4:42361] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,466 INFO [RS:2;jenkins-hbase4:42217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,466 INFO [RS:2;jenkins-hbase4:42217] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,466 INFO [RS:2;jenkins-hbase4:42217] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,471 INFO [RS:1;jenkins-hbase4:36223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,471 INFO [RS:1;jenkins-hbase4:36223] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,471 INFO [RS:1;jenkins-hbase4:36223] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,490 INFO [RS:0;jenkins-hbase4:42361] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 19:06:33,490 INFO [RS:2;jenkins-hbase4:42217] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 19:06:33,493 INFO [RS:2;jenkins-hbase4:42217] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42217,1689447992037-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,493 INFO [RS:0;jenkins-hbase4:42361] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42361,1689447991925-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,501 INFO [RS:1;jenkins-hbase4:36223] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 19:06:33,501 INFO [RS:1;jenkins-hbase4:36223] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36223,1689447992001-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:33,509 DEBUG [jenkins-hbase4:46803] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 19:06:33,510 INFO [RS:2;jenkins-hbase4:42217] regionserver.Replication(203): jenkins-hbase4.apache.org,42217,1689447992037 started 2023-07-15 19:06:33,510 INFO [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42217,1689447992037, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42217, sessionid=0x1016a6105630003 2023-07-15 19:06:33,511 DEBUG [RS:2;jenkins-hbase4:42217] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 19:06:33,511 DEBUG [RS:2;jenkins-hbase4:42217] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:33,511 DEBUG [RS:2;jenkins-hbase4:42217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42217,1689447992037' 2023-07-15 19:06:33,511 DEBUG [RS:2;jenkins-hbase4:42217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:33,511 DEBUG [RS:2;jenkins-hbase4:42217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:33,512 DEBUG [RS:2;jenkins-hbase4:42217] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 19:06:33,512 DEBUG [RS:2;jenkins-hbase4:42217] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 19:06:33,512 DEBUG [RS:2;jenkins-hbase4:42217] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:33,512 DEBUG [RS:2;jenkins-hbase4:42217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42217,1689447992037' 2023-07-15 19:06:33,512 DEBUG [RS:2;jenkins-hbase4:42217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 19:06:33,512 INFO [RS:0;jenkins-hbase4:42361] regionserver.Replication(203): jenkins-hbase4.apache.org,42361,1689447991925 started 2023-07-15 19:06:33,513 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42361,1689447991925, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42361, sessionid=0x1016a6105630001 2023-07-15 19:06:33,513 DEBUG [RS:0;jenkins-hbase4:42361] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 19:06:33,513 DEBUG [RS:0;jenkins-hbase4:42361] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,514 DEBUG [RS:0;jenkins-hbase4:42361] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42361,1689447991925' 2023-07-15 19:06:33,514 DEBUG [RS:2;jenkins-hbase4:42217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 19:06:33,514 DEBUG [RS:0;jenkins-hbase4:42361] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:33,515 DEBUG [jenkins-hbase4:46803] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:33,515 DEBUG [RS:0;jenkins-hbase4:42361] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:33,515 DEBUG [RS:2;jenkins-hbase4:42217] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 19:06:33,515 INFO [RS:2;jenkins-hbase4:42217] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 19:06:33,515 INFO [RS:2;jenkins-hbase4:42217] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 19:06:33,515 DEBUG [RS:0;jenkins-hbase4:42361] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 19:06:33,516 DEBUG [RS:0;jenkins-hbase4:42361] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 19:06:33,516 DEBUG [RS:0;jenkins-hbase4:42361] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,516 DEBUG [RS:0;jenkins-hbase4:42361] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42361,1689447991925' 2023-07-15 19:06:33,516 DEBUG [RS:0;jenkins-hbase4:42361] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 19:06:33,517 DEBUG [RS:0;jenkins-hbase4:42361] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 19:06:33,517 DEBUG [RS:0;jenkins-hbase4:42361] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 19:06:33,518 INFO [RS:0;jenkins-hbase4:42361] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 19:06:33,518 INFO [RS:0;jenkins-hbase4:42361] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 19:06:33,522 INFO [RS:1;jenkins-hbase4:36223] regionserver.Replication(203): jenkins-hbase4.apache.org,36223,1689447992001 started 2023-07-15 19:06:33,522 INFO [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36223,1689447992001, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36223, sessionid=0x1016a6105630002 2023-07-15 19:06:33,522 DEBUG [RS:1;jenkins-hbase4:36223] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 19:06:33,522 DEBUG [RS:1;jenkins-hbase4:36223] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:33,522 DEBUG [RS:1;jenkins-hbase4:36223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36223,1689447992001' 2023-07-15 19:06:33,522 DEBUG [RS:1;jenkins-hbase4:36223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:33,523 DEBUG [RS:1;jenkins-hbase4:36223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:33,523 DEBUG [jenkins-hbase4:46803] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:33,524 DEBUG [jenkins-hbase4:46803] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:33,524 DEBUG [RS:1;jenkins-hbase4:36223] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 19:06:33,524 DEBUG [jenkins-hbase4:46803] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:33,524 DEBUG [RS:1;jenkins-hbase4:36223] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 19:06:33,524 DEBUG [RS:1;jenkins-hbase4:36223] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:33,524 DEBUG [jenkins-hbase4:46803] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:33,524 DEBUG [RS:1;jenkins-hbase4:36223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36223,1689447992001' 2023-07-15 19:06:33,524 DEBUG [RS:1;jenkins-hbase4:36223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 19:06:33,525 DEBUG [RS:1;jenkins-hbase4:36223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 19:06:33,526 DEBUG [RS:1;jenkins-hbase4:36223] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 19:06:33,526 INFO [RS:1;jenkins-hbase4:36223] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 19:06:33,526 INFO [RS:1;jenkins-hbase4:36223] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 19:06:33,527 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42361,1689447991925, state=OPENING 2023-07-15 19:06:33,537 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 19:06:33,538 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:06:33,539 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 19:06:33,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:33,627 INFO [RS:2;jenkins-hbase4:42217] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42217%2C1689447992037, suffix=, logDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42217,1689447992037, archiveDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/oldWALs, maxLogs=32 2023-07-15 19:06:33,627 INFO [RS:0;jenkins-hbase4:42361] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42361%2C1689447991925, suffix=, logDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42361,1689447991925, archiveDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/oldWALs, maxLogs=32 2023-07-15 19:06:33,628 INFO [RS:1;jenkins-hbase4:36223] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36223%2C1689447992001, suffix=, logDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,36223,1689447992001, archiveDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/oldWALs, maxLogs=32 2023-07-15 19:06:33,686 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK] 2023-07-15 19:06:33,686 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK] 2023-07-15 19:06:33,689 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK] 2023-07-15 19:06:33,690 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK] 2023-07-15 19:06:33,690 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK] 2023-07-15 19:06:33,690 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK] 2023-07-15 19:06:33,690 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK] 2023-07-15 19:06:33,693 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK] 2023-07-15 19:06:33,693 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK] 2023-07-15 19:06:33,711 INFO [RS:1;jenkins-hbase4:36223] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,36223,1689447992001/jenkins-hbase4.apache.org%2C36223%2C1689447992001.1689447993631 2023-07-15 19:06:33,711 INFO [RS:2;jenkins-hbase4:42217] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42217,1689447992037/jenkins-hbase4.apache.org%2C42217%2C1689447992037.1689447993631 2023-07-15 19:06:33,711 INFO [RS:0;jenkins-hbase4:42361] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42361,1689447991925/jenkins-hbase4.apache.org%2C42361%2C1689447991925.1689447993631 2023-07-15 19:06:33,712 DEBUG [RS:1;jenkins-hbase4:36223] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK], DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK], DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK]] 2023-07-15 19:06:33,712 DEBUG [RS:2;jenkins-hbase4:42217] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK], DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK], DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK]] 2023-07-15 19:06:33,712 DEBUG [RS:0;jenkins-hbase4:42361] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK], DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK], DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK]] 2023-07-15 19:06:33,735 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:33,737 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 19:06:33,741 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 19:06:33,755 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 19:06:33,755 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 19:06:33,759 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42361%2C1689447991925.meta, suffix=.meta, logDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42361,1689447991925, archiveDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/oldWALs, maxLogs=32 2023-07-15 19:06:33,781 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK] 2023-07-15 19:06:33,783 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK] 2023-07-15 19:06:33,813 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK] 2023-07-15 19:06:33,825 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42361,1689447991925/jenkins-hbase4.apache.org%2C42361%2C1689447991925.meta.1689447993760.meta 2023-07-15 19:06:33,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38603,DS-939a477c-4d2a-4b1b-ab91-1fcf7df9de13,DISK], DatanodeInfoWithStorage[127.0.0.1:41319,DS-92c5d8a9-0796-4820-b56d-e1d8802f9bbe,DISK], DatanodeInfoWithStorage[127.0.0.1:38991,DS-8c742b49-9470-473e-b584-ba6045789e33,DISK]] 2023-07-15 19:06:33,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:33,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 19:06:33,849 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 19:06:33,853 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 19:06:33,858 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 19:06:33,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:33,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 19:06:33,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 19:06:33,862 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 19:06:33,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/info 2023-07-15 19:06:33,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/info 2023-07-15 19:06:33,864 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 19:06:33,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:33,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 19:06:33,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/rep_barrier 2023-07-15 19:06:33,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/rep_barrier 2023-07-15 19:06:33,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 19:06:33,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:33,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 19:06:33,869 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/table 2023-07-15 19:06:33,869 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/table 2023-07-15 19:06:33,870 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 19:06:33,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:33,872 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740 2023-07-15 19:06:33,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740 2023-07-15 19:06:33,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 19:06:33,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 19:06:33,882 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67668413, jitterRate=0.008337929844856262}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 19:06:33,883 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 19:06:33,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689447993724 2023-07-15 19:06:33,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 19:06:33,915 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 19:06:33,916 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42361,1689447991925, state=OPEN 2023-07-15 19:06:33,920 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 19:06:33,920 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 19:06:33,925 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 19:06:33,925 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42361,1689447991925 in 379 msec 2023-07-15 19:06:33,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 19:06:33,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 586 msec 2023-07-15 19:06:33,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 817 msec 2023-07-15 19:06:33,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689447993936, completionTime=-1 2023-07-15 19:06:33,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 19:06:33,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 19:06:34,004 DEBUG [hconnection-0x20d866e3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 19:06:34,007 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 19:06:34,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 19:06:34,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689448054023 2023-07-15 19:06:34,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689448114023 2023-07-15 19:06:34,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 86 msec 2023-07-15 19:06:34,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46803,1689447990709-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:34,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46803,1689447990709-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:34,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46803,1689447990709-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:34,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46803, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:34,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:34,062 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 19:06:34,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 19:06:34,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:34,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 19:06:34,088 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:34,090 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:34,113 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,115 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf empty. 2023-07-15 19:06:34,116 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,116 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 19:06:34,161 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:34,163 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 038e0c8cc632bc70d763e000d9f72faf, NAME => 'hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:34,183 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:34,184 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 038e0c8cc632bc70d763e000d9f72faf, disabling compactions & flushes 2023-07-15 19:06:34,184 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:06:34,184 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:06:34,184 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. after waiting 0 ms 2023-07-15 19:06:34,184 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:06:34,184 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:06:34,184 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 038e0c8cc632bc70d763e000d9f72faf: 2023-07-15 19:06:34,189 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:34,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689447994192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447994192"}]},"ts":"1689447994192"} 2023-07-15 19:06:34,230 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:34,232 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:34,237 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447994232"}]},"ts":"1689447994232"} 2023-07-15 19:06:34,244 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 19:06:34,249 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:34,250 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:34,250 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:34,250 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:34,250 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:34,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=038e0c8cc632bc70d763e000d9f72faf, ASSIGN}] 2023-07-15 19:06:34,256 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=038e0c8cc632bc70d763e000d9f72faf, ASSIGN 2023-07-15 19:06:34,257 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=038e0c8cc632bc70d763e000d9f72faf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:06:34,410 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:34,411 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=038e0c8cc632bc70d763e000d9f72faf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:34,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689447994411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447994411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447994411"}]},"ts":"1689447994411"} 2023-07-15 19:06:34,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 038e0c8cc632bc70d763e000d9f72faf, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:34,582 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:06:34,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 038e0c8cc632bc70d763e000d9f72faf, NAME => 'hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:34,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:34,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,586 INFO [StoreOpener-038e0c8cc632bc70d763e000d9f72faf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,588 DEBUG [StoreOpener-038e0c8cc632bc70d763e000d9f72faf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf/info 2023-07-15 19:06:34,588 DEBUG [StoreOpener-038e0c8cc632bc70d763e000d9f72faf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf/info 2023-07-15 19:06:34,588 INFO [StoreOpener-038e0c8cc632bc70d763e000d9f72faf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 038e0c8cc632bc70d763e000d9f72faf columnFamilyName info 2023-07-15 19:06:34,589 INFO [StoreOpener-038e0c8cc632bc70d763e000d9f72faf-1] regionserver.HStore(310): Store=038e0c8cc632bc70d763e000d9f72faf/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:34,591 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:06:34,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:34,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 038e0c8cc632bc70d763e000d9f72faf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60207575, jitterRate=-0.1028372198343277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:34,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 038e0c8cc632bc70d763e000d9f72faf: 2023-07-15 19:06:34,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf., pid=6, masterSystemTime=1689447994571 2023-07-15 19:06:34,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:06:34,606 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:06:34,608 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=038e0c8cc632bc70d763e000d9f72faf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:34,608 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689447994607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689447994607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689447994607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447994607"}]},"ts":"1689447994607"} 2023-07-15 19:06:34,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 19:06:34,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 038e0c8cc632bc70d763e000d9f72faf, server=jenkins-hbase4.apache.org,42361,1689447991925 in 194 msec 2023-07-15 19:06:34,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 19:06:34,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=038e0c8cc632bc70d763e000d9f72faf, ASSIGN in 362 msec 2023-07-15 19:06:34,620 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:34,620 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447994620"}]},"ts":"1689447994620"} 2023-07-15 19:06:34,623 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 19:06:34,626 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:34,628 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 552 msec 2023-07-15 19:06:34,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 19:06:34,691 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 19:06:34,691 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:06:34,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 19:06:34,747 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 19:06:34,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-15 19:06:34,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 19:06:34,778 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 19:06:34,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-15 19:06:34,790 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 19:06:34,794 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 19:06:34,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.693sec 2023-07-15 19:06:34,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 19:06:34,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 19:06:34,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 19:06:34,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46803,1689447990709-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 19:06:34,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46803,1689447990709-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 19:06:34,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 19:06:34,874 DEBUG [Listener at localhost/45529] zookeeper.ReadOnlyZKClient(139): Connect 0x23beefe9 to 127.0.0.1:56639 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 19:06:34,879 DEBUG [Listener at localhost/45529] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a7154e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 19:06:34,895 DEBUG [hconnection-0x2d246b2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 19:06:34,905 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 19:06:34,916 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:06:34,959 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testInvalidColumnDescriptor Thread=582, OpenFileDescriptor=694, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=170, AvailableMemoryMB=5546 2023-07-15 19:06:34,959 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=582 is superior to 500 2023-07-15 19:06:34,972 DEBUG [Listener at localhost/45529] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 19:06:34,976 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 19:06:35,003 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testInvalidColumnDescriptor Thread=583 (was 582) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=696 (was 694) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 292), ProcessCount=170 (was 170), AvailableMemoryMB=5544 (was 5546) 2023-07-15 19:06:35,003 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=583 is superior to 500 2023-07-15 19:06:35,019 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testMergeRegionsInvalidRegionCount Thread=583, OpenFileDescriptor=696, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=170, AvailableMemoryMB=5544 2023-07-15 19:06:35,019 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=583 is superior to 500 2023-07-15 19:06:35,030 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMergeRegionsInvalidRegionCount', {NAME => 'd', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:35,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMergeRegionsInvalidRegionCount 2023-07-15 19:06:35,034 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMergeRegionsInvalidRegionCount execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:35,036 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMergeRegionsInvalidRegionCount execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:35,039 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMergeRegionsInvalidRegionCount" procId is: 9 2023-07-15 19:06:35,042 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,042 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,042 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,043 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff empty. 2023-07-15 19:06:35,043 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029 empty. 2023-07-15 19:06:35,046 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998 empty. 2023-07-15 19:06:35,047 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,047 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,047 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,047 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMergeRegionsInvalidRegionCount regions 2023-07-15 19:06:35,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 19:06:35,070 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:35,073 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3f06b578a4539c884966dc0b13252029, NAME => 'testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.', STARTKEY => '3', ENDKEY => '6'}, tableDescriptor='testMergeRegionsInvalidRegionCount', {NAME => 'd', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:35,073 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(7675): creating {ENCODED => bcef556a3ded274888dbbf4024b6acff, NAME => 'testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.', STARTKEY => '', ENDKEY => '3'}, tableDescriptor='testMergeRegionsInvalidRegionCount', {NAME => 'd', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:35,073 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(7675): creating {ENCODED => ee694618a6aa115a2c5fad3e7c33c998, NAME => 'testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.', STARTKEY => '6', ENDKEY => ''}, tableDescriptor='testMergeRegionsInvalidRegionCount', {NAME => 'd', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:35,119 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(866): Instantiated testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:35,119 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(1604): Closing ee694618a6aa115a2c5fad3e7c33c998, disabling compactions & flushes 2023-07-15 19:06:35,120 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(1626): Closing region testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:35,120 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:35,120 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(866): Instantiated testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:35,120 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(1714): Acquired close lock on testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. after waiting 0 ms 2023-07-15 19:06:35,120 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(1604): Closing 3f06b578a4539c884966dc0b13252029, disabling compactions & flushes 2023-07-15 19:06:35,121 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(1724): Updates disabled for region testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:35,121 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(1626): Closing region testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:35,123 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:35,123 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(1838): Closed testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:35,123 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(1714): Acquired close lock on testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. after waiting 0 ms 2023-07-15 19:06:35,123 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-2] regionserver.HRegion(1558): Region close journal for ee694618a6aa115a2c5fad3e7c33c998: 2023-07-15 19:06:35,123 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(1724): Updates disabled for region testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:35,124 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(1838): Closed testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:35,124 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-1] regionserver.HRegion(1558): Region close journal for 3f06b578a4539c884966dc0b13252029: 2023-07-15 19:06:35,124 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(866): Instantiated testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:35,124 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(1604): Closing bcef556a3ded274888dbbf4024b6acff, disabling compactions & flushes 2023-07-15 19:06:35,124 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(1626): Closing region testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:35,124 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:35,124 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. after waiting 0 ms 2023-07-15 19:06:35,125 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:35,125 INFO [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(1838): Closed testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:35,125 DEBUG [RegionOpenAndInit-testMergeRegionsInvalidRegionCount-pool-0] regionserver.HRegion(1558): Region close journal for bcef556a3ded274888dbbf4024b6acff: 2023-07-15 19:06:35,129 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMergeRegionsInvalidRegionCount execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:35,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447995130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447995130"}]},"ts":"1689447995130"} 2023-07-15 19:06:35,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689447995130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447995130"}]},"ts":"1689447995130"} 2023-07-15 19:06:35,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447995130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447995130"}]},"ts":"1689447995130"} 2023-07-15 19:06:35,181 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-15 19:06:35,183 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMergeRegionsInvalidRegionCount execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:35,183 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMergeRegionsInvalidRegionCount","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447995183"}]},"ts":"1689447995183"} 2023-07-15 19:06:35,186 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMergeRegionsInvalidRegionCount, state=ENABLING in hbase:meta 2023-07-15 19:06:35,190 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:35,193 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:35,193 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:35,193 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:35,193 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:35,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=bcef556a3ded274888dbbf4024b6acff, ASSIGN}, {pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=3f06b578a4539c884966dc0b13252029, ASSIGN}, {pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=ee694618a6aa115a2c5fad3e7c33c998, ASSIGN}] 2023-07-15 19:06:35,196 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=3f06b578a4539c884966dc0b13252029, ASSIGN 2023-07-15 19:06:35,197 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=bcef556a3ded274888dbbf4024b6acff, ASSIGN 2023-07-15 19:06:35,197 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=ee694618a6aa115a2c5fad3e7c33c998, ASSIGN 2023-07-15 19:06:35,199 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=3f06b578a4539c884966dc0b13252029, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:06:35,199 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=bcef556a3ded274888dbbf4024b6acff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:35,199 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=ee694618a6aa115a2c5fad3e7c33c998, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:35,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 19:06:35,349 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 3 regions. 3 retained the pre-restart assignment. 2023-07-15 19:06:35,351 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=bcef556a3ded274888dbbf4024b6acff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:35,351 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ee694618a6aa115a2c5fad3e7c33c998, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:35,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3f06b578a4539c884966dc0b13252029, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:35,352 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447995351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447995351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447995351"}]},"ts":"1689447995351"} 2023-07-15 19:06:35,352 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447995351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447995351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447995351"}]},"ts":"1689447995351"} 2023-07-15 19:06:35,352 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689447995351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447995351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447995351"}]},"ts":"1689447995351"} 2023-07-15 19:06:35,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE; OpenRegionProcedure ee694618a6aa115a2c5fad3e7c33c998, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:35,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=10, state=RUNNABLE; OpenRegionProcedure bcef556a3ded274888dbbf4024b6acff, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:35,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=11, state=RUNNABLE; OpenRegionProcedure 3f06b578a4539c884966dc0b13252029, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:35,510 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:35,510 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:35,511 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 19:06:35,511 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 19:06:35,515 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 19:06:35,515 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 19:06:35,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:35,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f06b578a4539c884966dc0b13252029, NAME => 'testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.', STARTKEY => '3', ENDKEY => '6'} 2023-07-15 19:06:35,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:35,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ee694618a6aa115a2c5fad3e7c33c998, NAME => 'testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.', STARTKEY => '6', ENDKEY => ''} 2023-07-15 19:06:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMergeRegionsInvalidRegionCount 3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bcef556a3ded274888dbbf4024b6acff, NAME => 'testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.', STARTKEY => '', ENDKEY => '3'} 2023-07-15 19:06:35,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMergeRegionsInvalidRegionCount ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMergeRegionsInvalidRegionCount bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,526 INFO [StoreOpener-3f06b578a4539c884966dc0b13252029-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family d of region 3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,526 INFO [StoreOpener-bcef556a3ded274888dbbf4024b6acff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family d of region bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,526 INFO [StoreOpener-ee694618a6aa115a2c5fad3e7c33c998-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family d of region ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,528 DEBUG [StoreOpener-3f06b578a4539c884966dc0b13252029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029/d 2023-07-15 19:06:35,528 DEBUG [StoreOpener-3f06b578a4539c884966dc0b13252029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029/d 2023-07-15 19:06:35,528 DEBUG [StoreOpener-ee694618a6aa115a2c5fad3e7c33c998-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998/d 2023-07-15 19:06:35,528 DEBUG [StoreOpener-bcef556a3ded274888dbbf4024b6acff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff/d 2023-07-15 19:06:35,528 DEBUG [StoreOpener-ee694618a6aa115a2c5fad3e7c33c998-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998/d 2023-07-15 19:06:35,528 DEBUG [StoreOpener-bcef556a3ded274888dbbf4024b6acff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff/d 2023-07-15 19:06:35,529 INFO [StoreOpener-3f06b578a4539c884966dc0b13252029-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f06b578a4539c884966dc0b13252029 columnFamilyName d 2023-07-15 19:06:35,529 INFO [StoreOpener-bcef556a3ded274888dbbf4024b6acff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcef556a3ded274888dbbf4024b6acff columnFamilyName d 2023-07-15 19:06:35,529 INFO [StoreOpener-ee694618a6aa115a2c5fad3e7c33c998-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee694618a6aa115a2c5fad3e7c33c998 columnFamilyName d 2023-07-15 19:06:35,530 INFO [StoreOpener-3f06b578a4539c884966dc0b13252029-1] regionserver.HStore(310): Store=3f06b578a4539c884966dc0b13252029/d, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:35,532 INFO [StoreOpener-bcef556a3ded274888dbbf4024b6acff-1] regionserver.HStore(310): Store=bcef556a3ded274888dbbf4024b6acff/d, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:35,532 INFO [StoreOpener-ee694618a6aa115a2c5fad3e7c33c998-1] regionserver.HStore(310): Store=ee694618a6aa115a2c5fad3e7c33c998/d, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:35,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:35,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:35,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3f06b578a4539c884966dc0b13252029; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67947753, jitterRate=0.012500420212745667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3f06b578a4539c884966dc0b13252029: 2023-07-15 19:06:35,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029., pid=15, masterSystemTime=1689447995510 2023-07-15 19:06:35,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:35,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:35,551 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3f06b578a4539c884966dc0b13252029, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:35,552 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689447995551"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689447995551"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689447995551"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447995551"}]},"ts":"1689447995551"} 2023-07-15 19:06:35,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:35,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:35,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bcef556a3ded274888dbbf4024b6acff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67318588, jitterRate=0.003125131130218506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:35,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bcef556a3ded274888dbbf4024b6acff: 2023-07-15 19:06:35,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ee694618a6aa115a2c5fad3e7c33c998; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64927862, jitterRate=-0.032499462366104126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:35,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ee694618a6aa115a2c5fad3e7c33c998: 2023-07-15 19:06:35,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff., pid=14, masterSystemTime=1689447995510 2023-07-15 19:06:35,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998., pid=13, masterSystemTime=1689447995510 2023-07-15 19:06:35,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=11 2023-07-15 19:06:35,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=11, state=SUCCESS; OpenRegionProcedure 3f06b578a4539c884966dc0b13252029, server=jenkins-hbase4.apache.org,42361,1689447991925 in 202 msec 2023-07-15 19:06:35,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=3f06b578a4539c884966dc0b13252029, ASSIGN in 371 msec 2023-07-15 19:06:35,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:35,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:35,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:35,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:35,574 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ee694618a6aa115a2c5fad3e7c33c998, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:35,574 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447995573"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689447995573"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689447995573"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447995573"}]},"ts":"1689447995573"} 2023-07-15 19:06:35,575 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=bcef556a3ded274888dbbf4024b6acff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:35,575 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447995575"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689447995575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689447995575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447995575"}]},"ts":"1689447995575"} 2023-07-15 19:06:35,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-15 19:06:35,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; OpenRegionProcedure ee694618a6aa115a2c5fad3e7c33c998, server=jenkins-hbase4.apache.org,42217,1689447992037 in 223 msec 2023-07-15 19:06:35,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-07-15 19:06:35,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; OpenRegionProcedure bcef556a3ded274888dbbf4024b6acff, server=jenkins-hbase4.apache.org,36223,1689447992001 in 224 msec 2023-07-15 19:06:35,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=bcef556a3ded274888dbbf4024b6acff, ASSIGN in 394 msec 2023-07-15 19:06:35,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=9 2023-07-15 19:06:35,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=ee694618a6aa115a2c5fad3e7c33c998, ASSIGN in 393 msec 2023-07-15 19:06:35,593 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMergeRegionsInvalidRegionCount execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:35,593 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMergeRegionsInvalidRegionCount","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447995593"}]},"ts":"1689447995593"} 2023-07-15 19:06:35,595 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMergeRegionsInvalidRegionCount, state=ENABLED in hbase:meta 2023-07-15 19:06:35,600 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMergeRegionsInvalidRegionCount execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:35,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMergeRegionsInvalidRegionCount in 570 msec 2023-07-15 19:06:35,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 19:06:35,806 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMergeRegionsInvalidRegionCount, procId: 9 completed 2023-07-15 19:06:35,807 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testMergeRegionsInvalidRegionCount get assigned. Timeout = 60000ms 2023-07-15 19:06:35,809 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:35,814 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testMergeRegionsInvalidRegionCount assigned to meta. Checking AM states. 2023-07-15 19:06:35,815 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:35,815 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testMergeRegionsInvalidRegionCount assigned. 2023-07-15 19:06:35,816 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:35,831 DEBUG [hconnection-0x2d246b2-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 19:06:35,835 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 19:06:35,839 DEBUG [hconnection-0x2d246b2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 19:06:35,841 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 19:06:35,847 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testMergeRegionsInvalidRegionCount 2023-07-15 19:06:35,851 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testMergeRegionsInvalidRegionCount 2023-07-15 19:06:35,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=16, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testMergeRegionsInvalidRegionCount 2023-07-15 19:06:35,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMergeRegionsInvalidRegionCount","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447995862"}]},"ts":"1689447995862"} 2023-07-15 19:06:35,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-15 19:06:35,864 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMergeRegionsInvalidRegionCount, state=DISABLING in hbase:meta 2023-07-15 19:06:35,866 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testMergeRegionsInvalidRegionCount to state=DISABLING 2023-07-15 19:06:35,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=bcef556a3ded274888dbbf4024b6acff, UNASSIGN}, {pid=18, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=3f06b578a4539c884966dc0b13252029, UNASSIGN}, {pid=19, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=ee694618a6aa115a2c5fad3e7c33c998, UNASSIGN}] 2023-07-15 19:06:35,870 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=3f06b578a4539c884966dc0b13252029, UNASSIGN 2023-07-15 19:06:35,870 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=bcef556a3ded274888dbbf4024b6acff, UNASSIGN 2023-07-15 19:06:35,871 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=ee694618a6aa115a2c5fad3e7c33c998, UNASSIGN 2023-07-15 19:06:35,872 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3f06b578a4539c884966dc0b13252029, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:35,872 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689447995871"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447995871"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447995871"}]},"ts":"1689447995871"} 2023-07-15 19:06:35,872 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bcef556a3ded274888dbbf4024b6acff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:35,872 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ee694618a6aa115a2c5fad3e7c33c998, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:35,873 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447995872"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447995872"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447995872"}]},"ts":"1689447995872"} 2023-07-15 19:06:35,873 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447995872"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447995872"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447995872"}]},"ts":"1689447995872"} 2023-07-15 19:06:35,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=18, state=RUNNABLE; CloseRegionProcedure 3f06b578a4539c884966dc0b13252029, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:35,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; CloseRegionProcedure bcef556a3ded274888dbbf4024b6acff, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:35,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; CloseRegionProcedure ee694618a6aa115a2c5fad3e7c33c998, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:36,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:36,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:36,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:36,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ee694618a6aa115a2c5fad3e7c33c998, disabling compactions & flushes 2023-07-15 19:06:36,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bcef556a3ded274888dbbf4024b6acff, disabling compactions & flushes 2023-07-15 19:06:36,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3f06b578a4539c884966dc0b13252029, disabling compactions & flushes 2023-07-15 19:06:36,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:36,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:36,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. after waiting 0 ms 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. after waiting 0 ms 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. after waiting 0 ms 2023-07-15 19:06:36,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:36,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-15 19:06:36,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029. 2023-07-15 19:06:36,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3f06b578a4539c884966dc0b13252029: 2023-07-15 19:06:36,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-15 19:06:36,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-15 19:06:36,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998. 2023-07-15 19:06:36,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ee694618a6aa115a2c5fad3e7c33c998: 2023-07-15 19:06:36,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:36,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff. 2023-07-15 19:06:36,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bcef556a3ded274888dbbf4024b6acff: 2023-07-15 19:06:36,056 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3f06b578a4539c884966dc0b13252029, regionState=CLOSED 2023-07-15 19:06:36,057 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689447996056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447996056"}]},"ts":"1689447996056"} 2023-07-15 19:06:36,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:36,058 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ee694618a6aa115a2c5fad3e7c33c998, regionState=CLOSED 2023-07-15 19:06:36,058 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447996058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447996058"}]},"ts":"1689447996058"} 2023-07-15 19:06:36,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:36,059 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bcef556a3ded274888dbbf4024b6acff, regionState=CLOSED 2023-07-15 19:06:36,059 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689447996059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447996059"}]},"ts":"1689447996059"} 2023-07-15 19:06:36,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=18 2023-07-15 19:06:36,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=18, state=SUCCESS; CloseRegionProcedure 3f06b578a4539c884966dc0b13252029, server=jenkins-hbase4.apache.org,42361,1689447991925 in 184 msec 2023-07-15 19:06:36,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-07-15 19:06:36,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; CloseRegionProcedure ee694618a6aa115a2c5fad3e7c33c998, server=jenkins-hbase4.apache.org,42217,1689447992037 in 186 msec 2023-07-15 19:06:36,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=16, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=3f06b578a4539c884966dc0b13252029, UNASSIGN in 197 msec 2023-07-15 19:06:36,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-07-15 19:06:36,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; CloseRegionProcedure bcef556a3ded274888dbbf4024b6acff, server=jenkins-hbase4.apache.org,36223,1689447992001 in 188 msec 2023-07-15 19:06:36,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=16, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=ee694618a6aa115a2c5fad3e7c33c998, UNASSIGN in 198 msec 2023-07-15 19:06:36,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-15 19:06:36,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegionsInvalidRegionCount, region=bcef556a3ded274888dbbf4024b6acff, UNASSIGN in 199 msec 2023-07-15 19:06:36,070 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMergeRegionsInvalidRegionCount","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447996070"}]},"ts":"1689447996070"} 2023-07-15 19:06:36,072 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMergeRegionsInvalidRegionCount, state=DISABLED in hbase:meta 2023-07-15 19:06:36,074 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testMergeRegionsInvalidRegionCount to state=DISABLED 2023-07-15 19:06:36,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, state=SUCCESS; DisableTableProcedure table=testMergeRegionsInvalidRegionCount in 222 msec 2023-07-15 19:06:36,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-15 19:06:36,115 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testMergeRegionsInvalidRegionCount, procId: 16 completed 2023-07-15 19:06:36,119 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testMergeRegionsInvalidRegionCount 2023-07-15 19:06:36,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testMergeRegionsInvalidRegionCount 2023-07-15 19:06:36,129 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=23, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testMergeRegionsInvalidRegionCount 2023-07-15 19:06:36,130 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=23, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testMergeRegionsInvalidRegionCount 2023-07-15 19:06:36,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-15 19:06:36,139 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:36,139 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:36,140 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:36,144 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff/d, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff/recovered.edits] 2023-07-15 19:06:36,144 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029/d, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029/recovered.edits] 2023-07-15 19:06:36,144 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998/d, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998/recovered.edits] 2023-07-15 19:06:36,157 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998/recovered.edits/4.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998/recovered.edits/4.seqid 2023-07-15 19:06:36,157 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029/recovered.edits/4.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029/recovered.edits/4.seqid 2023-07-15 19:06:36,162 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/ee694618a6aa115a2c5fad3e7c33c998 2023-07-15 19:06:36,162 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/3f06b578a4539c884966dc0b13252029 2023-07-15 19:06:36,162 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff/recovered.edits/4.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff/recovered.edits/4.seqid 2023-07-15 19:06:36,163 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegionsInvalidRegionCount/bcef556a3ded274888dbbf4024b6acff 2023-07-15 19:06:36,163 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMergeRegionsInvalidRegionCount regions 2023-07-15 19:06:36,167 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=23, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testMergeRegionsInvalidRegionCount 2023-07-15 19:06:36,199 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testMergeRegionsInvalidRegionCount from hbase:meta 2023-07-15 19:06:36,203 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testMergeRegionsInvalidRegionCount' descriptor. 2023-07-15 19:06:36,205 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=23, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testMergeRegionsInvalidRegionCount 2023-07-15 19:06:36,205 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testMergeRegionsInvalidRegionCount' from region states. 2023-07-15 19:06:36,205 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689447996205"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:36,205 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689447996205"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:36,205 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689447996205"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:36,208 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-15 19:06:36,208 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bcef556a3ded274888dbbf4024b6acff, NAME => 'testMergeRegionsInvalidRegionCount,,1689447995026.bcef556a3ded274888dbbf4024b6acff.', STARTKEY => '', ENDKEY => '3'}, {ENCODED => 3f06b578a4539c884966dc0b13252029, NAME => 'testMergeRegionsInvalidRegionCount,3,1689447995026.3f06b578a4539c884966dc0b13252029.', STARTKEY => '3', ENDKEY => '6'}, {ENCODED => ee694618a6aa115a2c5fad3e7c33c998, NAME => 'testMergeRegionsInvalidRegionCount,6,1689447995026.ee694618a6aa115a2c5fad3e7c33c998.', STARTKEY => '6', ENDKEY => ''}] 2023-07-15 19:06:36,208 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testMergeRegionsInvalidRegionCount' as deleted. 2023-07-15 19:06:36,209 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegionsInvalidRegionCount","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689447996208"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:36,211 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testMergeRegionsInvalidRegionCount state from META 2023-07-15 19:06:36,214 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=23, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testMergeRegionsInvalidRegionCount 2023-07-15 19:06:36,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; DeleteTableProcedure table=testMergeRegionsInvalidRegionCount in 94 msec 2023-07-15 19:06:36,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-15 19:06:36,385 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testMergeRegionsInvalidRegionCount, procId: 23 completed 2023-07-15 19:06:36,408 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testMergeRegionsInvalidRegionCount Thread=607 (was 583) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_185109502_17 at /127.0.0.1:40154 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_5310775_17 at /127.0.0.1:38190 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=742 (was 696) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 292), ProcessCount=170 (was 170), AvailableMemoryMB=5529 (was 5544) 2023-07-15 19:06:36,410 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=607 is superior to 500 2023-07-15 19:06:36,427 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testSplitFlushCompactUnknownTable Thread=607, OpenFileDescriptor=742, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=170, AvailableMemoryMB=5528 2023-07-15 19:06:36,428 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=607 is superior to 500 2023-07-15 19:06:36,452 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testSplitFlushCompactUnknownTable Thread=607 (was 607), OpenFileDescriptor=742 (was 742), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 292), ProcessCount=170 (was 170), AvailableMemoryMB=5527 (was 5528) 2023-07-15 19:06:36,452 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=607 is superior to 500 2023-07-15 19:06:36,470 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testForceSplit Thread=607, OpenFileDescriptor=742, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=170, AvailableMemoryMB=5528 2023-07-15 19:06:36,471 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=607 is superior to 500 2023-07-15 19:06:36,476 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf must be between 1K and 16MB. 2023-07-15 19:06:36,477 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testForceSplit', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:36,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testForceSplit 2023-07-15 19:06:36,480 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=24, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:36,481 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testForceSplit" procId is: 24 2023-07-15 19:06:36,482 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=24, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:36,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-15 19:06:36,484 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,485 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb empty. 2023-07-15 19:06:36,485 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,485 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:36,512 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:36,514 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9f6d9bc79bc85542121ba1892fd6c2eb, NAME => 'testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testForceSplit', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:36,538 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:36,539 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1604): Closing 9f6d9bc79bc85542121ba1892fd6c2eb, disabling compactions & flushes 2023-07-15 19:06:36,539 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:36,539 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:36,539 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. after waiting 0 ms 2023-07-15 19:06:36,539 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:36,539 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1838): Closed testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:36,539 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1558): Region close journal for 9f6d9bc79bc85542121ba1892fd6c2eb: 2023-07-15 19:06:36,542 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=24, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:36,544 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447996544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447996544"}]},"ts":"1689447996544"} 2023-07-15 19:06:36,546 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:36,547 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=24, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:36,547 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447996547"}]},"ts":"1689447996547"} 2023-07-15 19:06:36,549 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLING in hbase:meta 2023-07-15 19:06:36,553 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:36,554 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:36,554 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:36,554 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:36,554 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:36,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=9f6d9bc79bc85542121ba1892fd6c2eb, ASSIGN}] 2023-07-15 19:06:36,556 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=9f6d9bc79bc85542121ba1892fd6c2eb, ASSIGN 2023-07-15 19:06:36,557 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=9f6d9bc79bc85542121ba1892fd6c2eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:06:36,707 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:36,709 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=9f6d9bc79bc85542121ba1892fd6c2eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:36,709 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447996709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447996709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447996709"}]},"ts":"1689447996709"} 2023-07-15 19:06:36,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE; OpenRegionProcedure 9f6d9bc79bc85542121ba1892fd6c2eb, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:36,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-15 19:06:36,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:36,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f6d9bc79bc85542121ba1892fd6c2eb, NAME => 'testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:36,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:36,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,873 INFO [StoreOpener-9f6d9bc79bc85542121ba1892fd6c2eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,874 DEBUG [StoreOpener-9f6d9bc79bc85542121ba1892fd6c2eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf 2023-07-15 19:06:36,874 DEBUG [StoreOpener-9f6d9bc79bc85542121ba1892fd6c2eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf 2023-07-15 19:06:36,875 INFO [StoreOpener-9f6d9bc79bc85542121ba1892fd6c2eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f6d9bc79bc85542121ba1892fd6c2eb columnFamilyName cf 2023-07-15 19:06:36,876 INFO [StoreOpener-9f6d9bc79bc85542121ba1892fd6c2eb-1] regionserver.HStore(310): Store=9f6d9bc79bc85542121ba1892fd6c2eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:36,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:36,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:36,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f6d9bc79bc85542121ba1892fd6c2eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58884222, jitterRate=-0.12255671620368958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:36,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f6d9bc79bc85542121ba1892fd6c2eb: 2023-07-15 19:06:36,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb., pid=26, masterSystemTime=1689447996864 2023-07-15 19:06:36,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:36,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:36,889 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=9f6d9bc79bc85542121ba1892fd6c2eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:36,890 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447996889"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689447996889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689447996889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447996889"}]},"ts":"1689447996889"} 2023-07-15 19:06:36,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=25 2023-07-15 19:06:36,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=25, state=SUCCESS; OpenRegionProcedure 9f6d9bc79bc85542121ba1892fd6c2eb, server=jenkins-hbase4.apache.org,42361,1689447991925 in 180 msec 2023-07-15 19:06:36,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-07-15 19:06:36,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=9f6d9bc79bc85542121ba1892fd6c2eb, ASSIGN in 341 msec 2023-07-15 19:06:36,899 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=24, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:36,900 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447996899"}]},"ts":"1689447996899"} 2023-07-15 19:06:36,901 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLED in hbase:meta 2023-07-15 19:06:36,904 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=24, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:36,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; CreateTableProcedure table=testForceSplit in 427 msec 2023-07-15 19:06:37,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-15 19:06:37,235 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testForceSplit, procId: 24 completed 2023-07-15 19:06:37,236 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testForceSplit get assigned. Timeout = 60000ms 2023-07-15 19:06:37,236 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:37,240 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testForceSplit assigned to meta. Checking AM states. 2023-07-15 19:06:37,240 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:37,240 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testForceSplit assigned. 2023-07-15 19:06:37,320 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42361] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6000 Client: jenkins//172.31.14.131 first region in multi=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:37,488 INFO [Listener at localhost/45529] client.TestAdmin1(291): Initial regions (1): [region=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb., hostname=jenkins-hbase4.apache.org,42361,1689447991925, seqNum=2] 2023-07-15 19:06:37,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42361] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:37,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42361] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:37,592 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:37,594 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(206): testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:37,601 INFO [RpcServer.priority.RWQ.Fifo.read.handler=16,queue=2,port=42361] regionserver.HRegion(2745): Flushing 9f6d9bc79bc85542121ba1892fd6c2eb 1/1 column families, dataSize=175.78 KB heapSize=609.63 KB 2023-07-15 19:06:37,745 INFO [RpcServer.priority.RWQ.Fifo.read.handler=16,queue=2,port=42361] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=175.78 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/.tmp/cf/2e243c9e543744b087c8dd1afd3e03ed 2023-07-15 19:06:37,792 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=16,queue=2,port=42361] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/.tmp/cf/2e243c9e543744b087c8dd1afd3e03ed as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed 2023-07-15 19:06:37,803 INFO [RpcServer.priority.RWQ.Fifo.read.handler=16,queue=2,port=42361] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed, entries=6000, sequenceid=5, filesize=237.3 K 2023-07-15 19:06:37,812 INFO [RpcServer.priority.RWQ.Fifo.read.handler=16,queue=2,port=42361] regionserver.HRegion(2948): Finished flush of dataSize ~175.78 KB/180000, heapSize ~609.61 KB/624240, currentSize=0 B/0 for 9f6d9bc79bc85542121ba1892fd6c2eb in 211ms, sequenceid=5, compaction requested=false 2023-07-15 19:06:37,814 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=16,queue=2,port=42361] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testForceSplit' 2023-07-15 19:06:37,816 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=16,queue=2,port=42361] regionserver.HRegion(2446): Flush status journal for 9f6d9bc79bc85542121ba1892fd6c2eb: 2023-07-15 19:06:37,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:37,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=9f6d9bc79bc85542121ba1892fd6c2eb, daughterA=5d3ba5f205a14257e73a4263ad934260, daughterB=358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:37,828 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=9f6d9bc79bc85542121ba1892fd6c2eb, daughterA=5d3ba5f205a14257e73a4263ad934260, daughterB=358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:37,828 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=9f6d9bc79bc85542121ba1892fd6c2eb, daughterA=5d3ba5f205a14257e73a4263ad934260, daughterB=358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:37,828 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=9f6d9bc79bc85542121ba1892fd6c2eb, daughterA=5d3ba5f205a14257e73a4263ad934260, daughterB=358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:37,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=9f6d9bc79bc85542121ba1892fd6c2eb, UNASSIGN}] 2023-07-15 19:06:37,840 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=9f6d9bc79bc85542121ba1892fd6c2eb, UNASSIGN 2023-07-15 19:06:37,840 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9f6d9bc79bc85542121ba1892fd6c2eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:37,841 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447997840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447997840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447997840"}]},"ts":"1689447997840"} 2023-07-15 19:06:37,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 9f6d9bc79bc85542121ba1892fd6c2eb, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:37,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:37,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f6d9bc79bc85542121ba1892fd6c2eb, disabling compactions & flushes 2023-07-15 19:06:37,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:37,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:37,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. after waiting 0 ms 2023-07-15 19:06:37,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:38,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 19:06:38,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:38,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f6d9bc79bc85542121ba1892fd6c2eb: 2023-07-15 19:06:38,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:38,010 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9f6d9bc79bc85542121ba1892fd6c2eb, regionState=CLOSED 2023-07-15 19:06:38,010 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447998010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447998010"}]},"ts":"1689447998010"} 2023-07-15 19:06:38,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=28 2023-07-15 19:06:38,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 9f6d9bc79bc85542121ba1892fd6c2eb, server=jenkins-hbase4.apache.org,42361,1689447991925 in 169 msec 2023-07-15 19:06:38,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 19:06:38,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=9f6d9bc79bc85542121ba1892fd6c2eb, UNASSIGN in 178 msec 2023-07-15 19:06:38,043 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=27 splitting 1 storefiles, region=9f6d9bc79bc85542121ba1892fd6c2eb, threads=1 2023-07-15 19:06:38,044 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=27 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed for region: 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:38,101 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=27 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed for region: 9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:38,101 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=27 split storefiles for region 9f6d9bc79bc85542121ba1892fd6c2eb Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-15 19:06:38,169 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 19:06:38,172 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 19:06:38,174 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447998174"},{"qualifier":"splitA","vlen":52,"tag":[],"timestamp":"1689447998174"},{"qualifier":"splitB","vlen":52,"tag":[],"timestamp":"1689447998174"}]},"ts":"1689447998174"} 2023-07-15 19:06:38,174 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447998174"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447998174"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447998174"}]},"ts":"1689447998174"} 2023-07-15 19:06:38,174 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447998174"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447998174"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447998174"}]},"ts":"1689447998174"} 2023-07-15 19:06:38,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=5d3ba5f205a14257e73a4263ad934260, ASSIGN}, {pid=31, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=358a6763cc76311f1e9617b5342aeaf8, ASSIGN}] 2023-07-15 19:06:38,224 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=358a6763cc76311f1e9617b5342aeaf8, ASSIGN 2023-07-15 19:06:38,224 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=5d3ba5f205a14257e73a4263ad934260, ASSIGN 2023-07-15 19:06:38,225 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=31, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=358a6763cc76311f1e9617b5342aeaf8, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:06:38,225 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=5d3ba5f205a14257e73a4263ad934260, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:06:38,375 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 19:06:38,378 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=358a6763cc76311f1e9617b5342aeaf8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:38,378 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5d3ba5f205a14257e73a4263ad934260, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:38,378 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447998377"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447998377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447998377"}]},"ts":"1689447998377"} 2023-07-15 19:06:38,378 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447998377"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447998377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447998377"}]},"ts":"1689447998377"} 2023-07-15 19:06:38,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE; OpenRegionProcedure 358a6763cc76311f1e9617b5342aeaf8, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:38,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 5d3ba5f205a14257e73a4263ad934260, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:38,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:38,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d3ba5f205a14257e73a4263ad934260, NAME => 'testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB5'} 2023-07-15 19:06:38,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:38,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:38,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:38,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:38,546 INFO [StoreOpener-5d3ba5f205a14257e73a4263ad934260-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:38,548 DEBUG [StoreOpener-5d3ba5f205a14257e73a4263ad934260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf 2023-07-15 19:06:38,548 DEBUG [StoreOpener-5d3ba5f205a14257e73a4263ad934260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf 2023-07-15 19:06:38,548 INFO [StoreOpener-5d3ba5f205a14257e73a4263ad934260-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d3ba5f205a14257e73a4263ad934260 columnFamilyName cf 2023-07-15 19:06:38,582 DEBUG [StoreOpener-5d3ba5f205a14257e73a4263ad934260-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed-bottom 2023-07-15 19:06:38,583 INFO [StoreOpener-5d3ba5f205a14257e73a4263ad934260-1] regionserver.HStore(310): Store=5d3ba5f205a14257e73a4263ad934260/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:38,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:38,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:38,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:38,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d3ba5f205a14257e73a4263ad934260; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72922982, jitterRate=0.08663710951805115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:38,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d3ba5f205a14257e73a4263ad934260: 2023-07-15 19:06:38,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260., pid=33, masterSystemTime=1689447998534 2023-07-15 19:06:38,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:38,598 DEBUG [RS:0;jenkins-hbase4:42361-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:38,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:38,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:38,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:38,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 358a6763cc76311f1e9617b5342aeaf8, NAME => 'testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.', STARTKEY => '\x00\x00\x0B\xB5', ENDKEY => ''} 2023-07-15 19:06:38,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:38,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:38,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:38,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:38,601 INFO [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:38,602 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5d3ba5f205a14257e73a4263ad934260, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:38,602 DEBUG [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.HStore(1912): 5d3ba5f205a14257e73a4263ad934260/cf is initiating minor compaction (all files) 2023-07-15 19:06:38,602 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447998601"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689447998601"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689447998601"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447998601"}]},"ts":"1689447998601"} 2023-07-15 19:06:38,602 INFO [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5d3ba5f205a14257e73a4263ad934260/cf in testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:38,602 INFO [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed-bottom] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/.tmp, totalSize=237.3 K 2023-07-15 19:06:38,604 DEBUG [RS:0;jenkins-hbase4:42361-shortCompactions-0] compactions.Compactor(207): Compacting 2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb, keycount=3000, bloomtype=ROW, size=237.3 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689447997370 2023-07-15 19:06:38,612 INFO [StoreOpener-358a6763cc76311f1e9617b5342aeaf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:38,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-07-15 19:06:38,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 5d3ba5f205a14257e73a4263ad934260, server=jenkins-hbase4.apache.org,42361,1689447991925 in 222 msec 2023-07-15 19:06:38,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=5d3ba5f205a14257e73a4263ad934260, ASSIGN in 392 msec 2023-07-15 19:06:38,616 DEBUG [StoreOpener-358a6763cc76311f1e9617b5342aeaf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf 2023-07-15 19:06:38,616 DEBUG [StoreOpener-358a6763cc76311f1e9617b5342aeaf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf 2023-07-15 19:06:38,616 INFO [StoreOpener-358a6763cc76311f1e9617b5342aeaf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 358a6763cc76311f1e9617b5342aeaf8 columnFamilyName cf 2023-07-15 19:06:38,629 DEBUG [StoreOpener-358a6763cc76311f1e9617b5342aeaf8-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed-top 2023-07-15 19:06:38,629 INFO [StoreOpener-358a6763cc76311f1e9617b5342aeaf8-1] regionserver.HStore(310): Store=358a6763cc76311f1e9617b5342aeaf8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:38,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:38,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:38,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:38,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 358a6763cc76311f1e9617b5342aeaf8; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59863053, jitterRate=-0.10797099769115448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:38,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 358a6763cc76311f1e9617b5342aeaf8: 2023-07-15 19:06:38,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8., pid=32, masterSystemTime=1689447998534 2023-07-15 19:06:38,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-15 19:06:38,642 DEBUG [RS:0;jenkins-hbase4:42361-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:38,644 INFO [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:38,645 DEBUG [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.HStore(1912): 358a6763cc76311f1e9617b5342aeaf8/cf is initiating minor compaction (all files) 2023-07-15 19:06:38,645 INFO [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 358a6763cc76311f1e9617b5342aeaf8/cf in testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:38,645 INFO [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed-top] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/.tmp, totalSize=237.3 K 2023-07-15 19:06:38,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:38,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:38,646 DEBUG [RS:0;jenkins-hbase4:42361-longCompactions-0] compactions.Compactor(207): Compacting 2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb, keycount=3000, bloomtype=ROW, size=237.3 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689447997370 2023-07-15 19:06:38,648 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=358a6763cc76311f1e9617b5342aeaf8, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:38,648 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,\\x00\\x00\\x0B\\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447998648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689447998648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689447998648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447998648"}]},"ts":"1689447998648"} 2023-07-15 19:06:38,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=31 2023-07-15 19:06:38,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=31, state=SUCCESS; OpenRegionProcedure 358a6763cc76311f1e9617b5342aeaf8, server=jenkins-hbase4.apache.org,42361,1689447991925 in 270 msec 2023-07-15 19:06:38,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=27 2023-07-15 19:06:38,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; SplitTableRegionProcedure table=testForceSplit, parent=9f6d9bc79bc85542121ba1892fd6c2eb, daughterA=5d3ba5f205a14257e73a4263ad934260, daughterB=358a6763cc76311f1e9617b5342aeaf8 in 835 msec 2023-07-15 19:06:38,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=358a6763cc76311f1e9617b5342aeaf8, ASSIGN in 431 msec 2023-07-15 19:06:38,760 INFO [RS:0;jenkins-hbase4:42361-longCompactions-0] throttle.PressureAwareThroughputController(145): 358a6763cc76311f1e9617b5342aeaf8#cf#compaction#2 average throughput is 0.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:38,768 INFO [RS:0;jenkins-hbase4:42361-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5d3ba5f205a14257e73a4263ad934260#cf#compaction#1 average throughput is 0.60 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:38,787 DEBUG [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/.tmp/cf/85d81e188d8347558981dd3456fb78eb as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf/85d81e188d8347558981dd3456fb78eb 2023-07-15 19:06:38,793 DEBUG [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/.tmp/cf/7970e38a662a451f8445ca6772a2413e as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf/7970e38a662a451f8445ca6772a2413e 2023-07-15 19:06:38,813 INFO [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 5d3ba5f205a14257e73a4263ad934260/cf of 5d3ba5f205a14257e73a4263ad934260 into 7970e38a662a451f8445ca6772a2413e(size=120.9 K), total size for store is 120.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:38,813 INFO [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 358a6763cc76311f1e9617b5342aeaf8/cf of 358a6763cc76311f1e9617b5342aeaf8 into 85d81e188d8347558981dd3456fb78eb(size=121.2 K), total size for store is 121.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:38,813 DEBUG [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5d3ba5f205a14257e73a4263ad934260: 2023-07-15 19:06:38,813 DEBUG [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 358a6763cc76311f1e9617b5342aeaf8: 2023-07-15 19:06:38,813 INFO [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260., storeName=5d3ba5f205a14257e73a4263ad934260/cf, priority=15, startTime=1689447998596; duration=0sec 2023-07-15 19:06:38,813 INFO [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8., storeName=358a6763cc76311f1e9617b5342aeaf8/cf, priority=15, startTime=1689447998641; duration=0sec 2023-07-15 19:06:38,814 DEBUG [RS:0;jenkins-hbase4:42361-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:38,814 DEBUG [RS:0;jenkins-hbase4:42361-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:38,842 INFO [CheckForSplit] client.TestAdmin1$1(333): Found: [region=testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260., hostname=jenkins-hbase4.apache.org,42361,1689447991925, seqNum=9, region=testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8., hostname=jenkins-hbase4.apache.org,42361,1689447991925, seqNum=9] 2023-07-15 19:06:38,843 DEBUG [CheckForSplit] client.TestAdmin1$1(338): CheckForSplit thread exited, current region count: 2 2023-07-15 19:06:38,843 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42361] regionserver.RSRpcServices(3109): Region has changed on the scanner 2331067502466957329: regionName=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb., scannerRegionName=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb., closing... 2023-07-15 19:06:38,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42361] ipc.CallRunner(144): callId: 62 service: ClientService methodName: Scan size: 46 connection: 172.31.14.131:38458 deadline: 1689448058843, exception=org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner 2331067502466957329: regionName=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb., scannerRegionName=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. 2023-07-15 19:06:38,846 DEBUG [Listener at localhost/45529] client.ScannerCallableWithReplicas(204): Scan with primary region returns org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:228) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:258) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:58) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:124) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:393) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:367) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner 2331067502466957329: regionName=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb., scannerRegionName=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:194) ... 11 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner 2331067502466957329: regionName=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb., scannerRegionName=testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-15 19:06:38,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42361] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:38,925 DEBUG [Listener at localhost/45529] client.ClientScanner(240): Advancing internal scanner to startKey at '\x00\x00\x0B\xB5', inclusive 2023-07-15 19:06:38,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42361] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:38,974 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testForceSplit 2023-07-15 19:06:38,974 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testForceSplit 2023-07-15 19:06:38,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testForceSplit 2023-07-15 19:06:38,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2023-07-15 19:06:38,981 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447998981"}]},"ts":"1689447998981"} 2023-07-15 19:06:38,983 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLING in hbase:meta 2023-07-15 19:06:38,985 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testForceSplit to state=DISABLING 2023-07-15 19:06:38,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=35, ppid=34, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=358a6763cc76311f1e9617b5342aeaf8, UNASSIGN}, {pid=36, ppid=34, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=5d3ba5f205a14257e73a4263ad934260, UNASSIGN}] 2023-07-15 19:06:38,988 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=34, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=358a6763cc76311f1e9617b5342aeaf8, UNASSIGN 2023-07-15 19:06:38,989 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=34, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=5d3ba5f205a14257e73a4263ad934260, UNASSIGN 2023-07-15 19:06:38,991 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=358a6763cc76311f1e9617b5342aeaf8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:38,991 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5d3ba5f205a14257e73a4263ad934260, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:38,991 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447998991"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447998991"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447998991"}]},"ts":"1689447998991"} 2023-07-15 19:06:38,991 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447998991"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447998991"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447998991"}]},"ts":"1689447998991"} 2023-07-15 19:06:38,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=35, state=RUNNABLE; CloseRegionProcedure 358a6763cc76311f1e9617b5342aeaf8, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:38,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=36, state=RUNNABLE; CloseRegionProcedure 5d3ba5f205a14257e73a4263ad934260, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:39,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:39,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 358a6763cc76311f1e9617b5342aeaf8, disabling compactions & flushes 2023-07-15 19:06:39,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:39,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:39,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. after waiting 0 ms 2023-07-15 19:06:39,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:39,150 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed-top] to archive 2023-07-15 19:06:39,151 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:39,157 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:39,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 19:06:39,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8. 2023-07-15 19:06:39,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 358a6763cc76311f1e9617b5342aeaf8: 2023-07-15 19:06:39,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:39,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:39,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d3ba5f205a14257e73a4263ad934260, disabling compactions & flushes 2023-07-15 19:06:39,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:39,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:39,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. after waiting 0 ms 2023-07-15 19:06:39,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:39,190 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=358a6763cc76311f1e9617b5342aeaf8, regionState=CLOSED 2023-07-15 19:06:39,193 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,\\x00\\x00\\x0B\\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447999190"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447999190"}]},"ts":"1689447999190"} 2023-07-15 19:06:39,193 DEBUG [StoreCloser-testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed-bottom] to archive 2023-07-15 19:06:39,194 DEBUG [StoreCloser-testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:39,198 DEBUG [StoreCloser-testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf/2e243c9e543744b087c8dd1afd3e03ed.9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:39,198 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=35 2023-07-15 19:06:39,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=35, state=SUCCESS; CloseRegionProcedure 358a6763cc76311f1e9617b5342aeaf8, server=jenkins-hbase4.apache.org,42361,1689447991925 in 201 msec 2023-07-15 19:06:39,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=34, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=358a6763cc76311f1e9617b5342aeaf8, UNASSIGN in 214 msec 2023-07-15 19:06:39,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 19:06:39,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260. 2023-07-15 19:06:39,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d3ba5f205a14257e73a4263ad934260: 2023-07-15 19:06:39,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:39,210 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5d3ba5f205a14257e73a4263ad934260, regionState=CLOSED 2023-07-15 19:06:39,210 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689447999210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447999210"}]},"ts":"1689447999210"} 2023-07-15 19:06:39,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-15 19:06:39,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; CloseRegionProcedure 5d3ba5f205a14257e73a4263ad934260, server=jenkins-hbase4.apache.org,42361,1689447991925 in 218 msec 2023-07-15 19:06:39,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=34 2023-07-15 19:06:39,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=34, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=5d3ba5f205a14257e73a4263ad934260, UNASSIGN in 229 msec 2023-07-15 19:06:39,217 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447999217"}]},"ts":"1689447999217"} 2023-07-15 19:06:39,218 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLED in hbase:meta 2023-07-15 19:06:39,220 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testForceSplit to state=DISABLED 2023-07-15 19:06:39,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; DisableTableProcedure table=testForceSplit in 246 msec 2023-07-15 19:06:39,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2023-07-15 19:06:39,232 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testForceSplit, procId: 34 completed 2023-07-15 19:06:39,233 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testForceSplit 2023-07-15 19:06:39,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:39,236 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=39, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:39,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-15 19:06:39,238 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=39, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:39,254 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:39,254 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:39,254 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:39,263 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/recovered.edits] 2023-07-15 19:06:39,264 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/recovered.edits] 2023-07-15 19:06:39,265 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/recovered.edits] 2023-07-15 19:06:39,277 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf/85d81e188d8347558981dd3456fb78eb to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/cf/85d81e188d8347558981dd3456fb78eb 2023-07-15 19:06:39,278 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf/7970e38a662a451f8445ca6772a2413e to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/cf/7970e38a662a451f8445ca6772a2413e 2023-07-15 19:06:39,279 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/cf/2e243c9e543744b087c8dd1afd3e03ed 2023-07-15 19:06:39,284 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/recovered.edits/12.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8/recovered.edits/12.seqid 2023-07-15 19:06:39,285 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/358a6763cc76311f1e9617b5342aeaf8 2023-07-15 19:06:39,285 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/recovered.edits/12.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260/recovered.edits/12.seqid 2023-07-15 19:06:39,285 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/recovered.edits/8.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb/recovered.edits/8.seqid 2023-07-15 19:06:39,286 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5d3ba5f205a14257e73a4263ad934260 2023-07-15 19:06:39,286 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9f6d9bc79bc85542121ba1892fd6c2eb 2023-07-15 19:06:39,286 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:39,290 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=39, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:39,293 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testForceSplit from hbase:meta 2023-07-15 19:06:39,296 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testForceSplit' descriptor. 2023-07-15 19:06:39,298 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=39, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:39,298 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testForceSplit' from region states. 2023-07-15 19:06:39,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,\\x00\\x00\\x0B\\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689447999298"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:39,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689447999298"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:39,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689447999298"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:39,301 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-15 19:06:39,301 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 358a6763cc76311f1e9617b5342aeaf8, NAME => 'testForceSplit,\x00\x00\x0B\xB5,1689447997820.358a6763cc76311f1e9617b5342aeaf8.', STARTKEY => '\x00\x00\x0B\xB5', ENDKEY => ''}, {ENCODED => 9f6d9bc79bc85542121ba1892fd6c2eb, NAME => 'testForceSplit,,1689447996476.9f6d9bc79bc85542121ba1892fd6c2eb.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 5d3ba5f205a14257e73a4263ad934260, NAME => 'testForceSplit,,1689447997820.5d3ba5f205a14257e73a4263ad934260.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB5'}] 2023-07-15 19:06:39,301 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testForceSplit' as deleted. 2023-07-15 19:06:39,301 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689447999301"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:39,303 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testForceSplit state from META 2023-07-15 19:06:39,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=39, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:39,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; DeleteTableProcedure table=testForceSplit in 72 msec 2023-07-15 19:06:39,400 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 19:06:39,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-15 19:06:39,489 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testForceSplit, procId: 39 completed 2023-07-15 19:06:39,493 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf must be between 1K and 16MB. 2023-07-15 19:06:39,493 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testForceSplit', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:39,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=40, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testForceSplit 2023-07-15 19:06:39,497 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 19:06:39,498 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=40, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:39,498 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 19:06:39,498 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testForceSplit" procId is: 40 2023-07-15 19:06:39,499 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=40, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:39,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=40 2023-07-15 19:06:39,501 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,502 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e empty. 2023-07-15 19:06:39,503 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,503 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:39,525 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:39,527 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => db2b074b0ac92c3cbda8af48c0af328e, NAME => 'testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testForceSplit', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:39,544 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:39,544 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1604): Closing db2b074b0ac92c3cbda8af48c0af328e, disabling compactions & flushes 2023-07-15 19:06:39,544 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:39,544 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:39,544 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. after waiting 0 ms 2023-07-15 19:06:39,544 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:39,544 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1838): Closed testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:39,544 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1558): Region close journal for db2b074b0ac92c3cbda8af48c0af328e: 2023-07-15 19:06:39,547 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=40, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:39,550 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447999549"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689447999549"}]},"ts":"1689447999549"} 2023-07-15 19:06:39,552 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:39,553 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=40, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:39,553 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447999553"}]},"ts":"1689447999553"} 2023-07-15 19:06:39,555 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLING in hbase:meta 2023-07-15 19:06:39,564 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:39,565 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:39,565 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:39,565 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:39,566 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:39,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=db2b074b0ac92c3cbda8af48c0af328e, ASSIGN}] 2023-07-15 19:06:39,568 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=40, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=db2b074b0ac92c3cbda8af48c0af328e, ASSIGN 2023-07-15 19:06:39,569 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=41, ppid=40, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=db2b074b0ac92c3cbda8af48c0af328e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:39,719 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:39,721 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=db2b074b0ac92c3cbda8af48c0af328e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:39,721 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447999721"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689447999721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689447999721"}]},"ts":"1689447999721"} 2023-07-15 19:06:39,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; OpenRegionProcedure db2b074b0ac92c3cbda8af48c0af328e, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:39,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=40 2023-07-15 19:06:39,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:39,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db2b074b0ac92c3cbda8af48c0af328e, NAME => 'testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:39,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:39,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,881 INFO [StoreOpener-db2b074b0ac92c3cbda8af48c0af328e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,883 DEBUG [StoreOpener-db2b074b0ac92c3cbda8af48c0af328e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf 2023-07-15 19:06:39,883 DEBUG [StoreOpener-db2b074b0ac92c3cbda8af48c0af328e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf 2023-07-15 19:06:39,884 INFO [StoreOpener-db2b074b0ac92c3cbda8af48c0af328e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db2b074b0ac92c3cbda8af48c0af328e columnFamilyName cf 2023-07-15 19:06:39,885 INFO [StoreOpener-db2b074b0ac92c3cbda8af48c0af328e-1] regionserver.HStore(310): Store=db2b074b0ac92c3cbda8af48c0af328e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:39,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:39,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db2b074b0ac92c3cbda8af48c0af328e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63169207, jitterRate=-0.058705464005470276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:39,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db2b074b0ac92c3cbda8af48c0af328e: 2023-07-15 19:06:39,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e., pid=42, masterSystemTime=1689447999875 2023-07-15 19:06:39,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:39,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:39,902 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=db2b074b0ac92c3cbda8af48c0af328e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:39,902 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689447999901"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689447999901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689447999901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689447999901"}]},"ts":"1689447999901"} 2023-07-15 19:06:39,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=41 2023-07-15 19:06:39,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=41, state=SUCCESS; OpenRegionProcedure db2b074b0ac92c3cbda8af48c0af328e, server=jenkins-hbase4.apache.org,36223,1689447992001 in 181 msec 2023-07-15 19:06:39,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-07-15 19:06:39,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=db2b074b0ac92c3cbda8af48c0af328e, ASSIGN in 340 msec 2023-07-15 19:06:39,911 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=40, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:39,912 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689447999912"}]},"ts":"1689447999912"} 2023-07-15 19:06:39,913 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLED in hbase:meta 2023-07-15 19:06:39,917 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=40, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:39,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, state=SUCCESS; CreateTableProcedure table=testForceSplit in 424 msec 2023-07-15 19:06:40,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=40 2023-07-15 19:06:40,253 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testForceSplit, procId: 40 completed 2023-07-15 19:06:40,253 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testForceSplit get assigned. Timeout = 60000ms 2023-07-15 19:06:40,253 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:40,257 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testForceSplit assigned to meta. Checking AM states. 2023-07-15 19:06:40,257 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:40,257 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testForceSplit assigned. 2023-07-15 19:06:40,283 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6000 Client: jenkins//172.31.14.131 first region in multi=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:40,336 INFO [Listener at localhost/45529] client.TestAdmin1(291): Initial regions (1): [region=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=2] 2023-07-15 19:06:40,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:40,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:40,386 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:40,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:40,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=db2b074b0ac92c3cbda8af48c0af328e, daughterA=ccf7979e0df4996c0dd61b31163ecd99, daughterB=88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:40,391 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=db2b074b0ac92c3cbda8af48c0af328e, daughterA=ccf7979e0df4996c0dd61b31163ecd99, daughterB=88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:40,391 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=db2b074b0ac92c3cbda8af48c0af328e, daughterA=ccf7979e0df4996c0dd61b31163ecd99, daughterB=88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:40,391 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=db2b074b0ac92c3cbda8af48c0af328e, daughterA=ccf7979e0df4996c0dd61b31163ecd99, daughterB=88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:40,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=db2b074b0ac92c3cbda8af48c0af328e, UNASSIGN}] 2023-07-15 19:06:40,396 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=db2b074b0ac92c3cbda8af48c0af328e, UNASSIGN 2023-07-15 19:06:40,397 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=db2b074b0ac92c3cbda8af48c0af328e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:40,397 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448000397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448000397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448000397"}]},"ts":"1689448000397"} 2023-07-15 19:06:40,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; CloseRegionProcedure db2b074b0ac92c3cbda8af48c0af328e, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:40,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:40,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db2b074b0ac92c3cbda8af48c0af328e, disabling compactions & flushes 2023-07-15 19:06:40,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:40,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:40,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. after waiting 0 ms 2023-07-15 19:06:40,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:40,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing db2b074b0ac92c3cbda8af48c0af328e 1/1 column families, dataSize=175.78 KB heapSize=609.63 KB 2023-07-15 19:06:40,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=175.78 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/.tmp/cf/317f77fc6aeb486495f43defd23b7c96 2023-07-15 19:06:40,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/.tmp/cf/317f77fc6aeb486495f43defd23b7c96 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96 2023-07-15 19:06:40,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96, entries=6000, sequenceid=5, filesize=237.3 K 2023-07-15 19:06:40,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~175.78 KB/180000, heapSize ~609.61 KB/624240, currentSize=0 B/0 for db2b074b0ac92c3cbda8af48c0af328e in 56ms, sequenceid=5, compaction requested=false 2023-07-15 19:06:40,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 19:06:40,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:40,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db2b074b0ac92c3cbda8af48c0af328e: 2023-07-15 19:06:40,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:40,627 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=db2b074b0ac92c3cbda8af48c0af328e, regionState=CLOSED 2023-07-15 19:06:40,628 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448000627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448000627"}]},"ts":"1689448000627"} 2023-07-15 19:06:40,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-15 19:06:40,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; CloseRegionProcedure db2b074b0ac92c3cbda8af48c0af328e, server=jenkins-hbase4.apache.org,36223,1689447992001 in 230 msec 2023-07-15 19:06:40,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-07-15 19:06:40,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=db2b074b0ac92c3cbda8af48c0af328e, UNASSIGN in 238 msec 2023-07-15 19:06:40,649 INFO [PEWorker-1] assignment.SplitTableRegionProcedure(694): pid=43 splitting 1 storefiles, region=db2b074b0ac92c3cbda8af48c0af328e, threads=1 2023-07-15 19:06:40,650 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=43 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96 for region: db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:40,697 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=43 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96 for region: db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:40,697 DEBUG [PEWorker-1] assignment.SplitTableRegionProcedure(755): pid=43 split storefiles for region db2b074b0ac92c3cbda8af48c0af328e Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-15 19:06:40,757 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 19:06:40,761 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 19:06:40,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448000764"},{"qualifier":"splitA","vlen":52,"tag":[],"timestamp":"1689448000764"},{"qualifier":"splitB","vlen":52,"tag":[],"timestamp":"1689448000764"}]},"ts":"1689448000764"} 2023-07-15 19:06:40,765 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448000764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448000764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448000764"}]},"ts":"1689448000764"} 2023-07-15 19:06:40,765 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448000764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448000764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448000764"}]},"ts":"1689448000764"} 2023-07-15 19:06:40,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=ccf7979e0df4996c0dd61b31163ecd99, ASSIGN}, {pid=47, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=88c7336e4a3721e3a2e317c575ec50a3, ASSIGN}] 2023-07-15 19:06:40,771 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=47, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=88c7336e4a3721e3a2e317c575ec50a3, ASSIGN 2023-07-15 19:06:40,771 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=46, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=ccf7979e0df4996c0dd61b31163ecd99, ASSIGN 2023-07-15 19:06:40,773 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=47, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=88c7336e4a3721e3a2e317c575ec50a3, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:40,773 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=46, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=ccf7979e0df4996c0dd61b31163ecd99, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:40,870 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 19:06:40,871 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 19:06:40,923 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 19:06:40,926 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=47 updating hbase:meta row=88c7336e4a3721e3a2e317c575ec50a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:40,926 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=46 updating hbase:meta row=ccf7979e0df4996c0dd61b31163ecd99, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:40,926 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448000926"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448000926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448000926"}]},"ts":"1689448000926"} 2023-07-15 19:06:40,926 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448000926"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448000926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448000926"}]},"ts":"1689448000926"} 2023-07-15 19:06:40,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=47, state=RUNNABLE; OpenRegionProcedure 88c7336e4a3721e3a2e317c575ec50a3, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:40,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=46, state=RUNNABLE; OpenRegionProcedure ccf7979e0df4996c0dd61b31163ecd99, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:41,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88c7336e4a3721e3a2e317c575ec50a3, NAME => 'testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.', STARTKEY => '\x00\x00\x0D\xAC', ENDKEY => ''} 2023-07-15 19:06:41,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:41,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,087 INFO [StoreOpener-88c7336e4a3721e3a2e317c575ec50a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,088 DEBUG [StoreOpener-88c7336e4a3721e3a2e317c575ec50a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf 2023-07-15 19:06:41,088 DEBUG [StoreOpener-88c7336e4a3721e3a2e317c575ec50a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf 2023-07-15 19:06:41,089 INFO [StoreOpener-88c7336e4a3721e3a2e317c575ec50a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88c7336e4a3721e3a2e317c575ec50a3 columnFamilyName cf 2023-07-15 19:06:41,102 DEBUG [StoreOpener-88c7336e4a3721e3a2e317c575ec50a3-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96-top 2023-07-15 19:06:41,102 INFO [StoreOpener-88c7336e4a3721e3a2e317c575ec50a3-1] regionserver.HStore(310): Store=88c7336e4a3721e3a2e317c575ec50a3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:41,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88c7336e4a3721e3a2e317c575ec50a3; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72316823, jitterRate=0.07760463654994965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:41,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88c7336e4a3721e3a2e317c575ec50a3: 2023-07-15 19:06:41,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3., pid=48, masterSystemTime=1689448001081 2023-07-15 19:06:41,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:41,112 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:41,113 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,113 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1912): 88c7336e4a3721e3a2e317c575ec50a3/cf is initiating minor compaction (all files) 2023-07-15 19:06:41,113 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 88c7336e4a3721e3a2e317c575ec50a3/cf in testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,113 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96-top] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/.tmp, totalSize=237.3 K 2023-07-15 19:06:41,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ccf7979e0df4996c0dd61b31163ecd99, NAME => 'testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.', STARTKEY => '', ENDKEY => '\x00\x00\x0D\xAC'} 2023-07-15 19:06:41,114 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=47 updating hbase:meta row=88c7336e4a3721e3a2e317c575ec50a3, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:41,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,114 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448001114"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448001114"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448001114"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448001114"}]},"ts":"1689448001114"} 2023-07-15 19:06:41,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:41,114 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] compactions.Compactor(207): Compacting 317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e, keycount=3000, bloomtype=ROW, size=237.3 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689448000301 2023-07-15 19:06:41,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,117 INFO [StoreOpener-ccf7979e0df4996c0dd61b31163ecd99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,119 DEBUG [StoreOpener-ccf7979e0df4996c0dd61b31163ecd99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf 2023-07-15 19:06:41,119 DEBUG [StoreOpener-ccf7979e0df4996c0dd61b31163ecd99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf 2023-07-15 19:06:41,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=47 2023-07-15 19:06:41,120 INFO [StoreOpener-ccf7979e0df4996c0dd61b31163ecd99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccf7979e0df4996c0dd61b31163ecd99 columnFamilyName cf 2023-07-15 19:06:41,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=47, state=SUCCESS; OpenRegionProcedure 88c7336e4a3721e3a2e317c575ec50a3, server=jenkins-hbase4.apache.org,36223,1689447992001 in 189 msec 2023-07-15 19:06:41,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=88c7336e4a3721e3a2e317c575ec50a3, ASSIGN in 350 msec 2023-07-15 19:06:41,135 DEBUG [StoreOpener-ccf7979e0df4996c0dd61b31163ecd99-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96-bottom 2023-07-15 19:06:41,135 INFO [StoreOpener-ccf7979e0df4996c0dd61b31163ecd99-1] regionserver.HStore(310): Store=ccf7979e0df4996c0dd61b31163ecd99/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:41,136 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] throttle.PressureAwareThroughputController(145): 88c7336e4a3721e3a2e317c575ec50a3#cf#compaction#4 average throughput is 4.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:41,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ccf7979e0df4996c0dd61b31163ecd99; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64013188, jitterRate=-0.04612916707992554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:41,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ccf7979e0df4996c0dd61b31163ecd99: 2023-07-15 19:06:41,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99., pid=49, masterSystemTime=1689448001081 2023-07-15 19:06:41,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-15 19:06:41,152 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:41,154 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,154 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1912): ccf7979e0df4996c0dd61b31163ecd99/cf is initiating minor compaction (all files) 2023-07-15 19:06:41,154 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegion(2259): Starting compaction of ccf7979e0df4996c0dd61b31163ecd99/cf in testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,156 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96-bottom] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/.tmp, totalSize=237.3 K 2023-07-15 19:06:41,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,157 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] compactions.Compactor(207): Compacting 317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e, keycount=3000, bloomtype=ROW, size=237.3 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689448000301 2023-07-15 19:06:41,157 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=46 updating hbase:meta row=ccf7979e0df4996c0dd61b31163ecd99, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:41,157 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448001157"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448001157"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448001157"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448001157"}]},"ts":"1689448001157"} 2023-07-15 19:06:41,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=46 2023-07-15 19:06:41,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=46, state=SUCCESS; OpenRegionProcedure ccf7979e0df4996c0dd61b31163ecd99, server=jenkins-hbase4.apache.org,36223,1689447992001 in 232 msec 2023-07-15 19:06:41,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-15 19:06:41,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=ccf7979e0df4996c0dd61b31163ecd99, ASSIGN in 393 msec 2023-07-15 19:06:41,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; SplitTableRegionProcedure table=testForceSplit, parent=db2b074b0ac92c3cbda8af48c0af328e, daughterA=ccf7979e0df4996c0dd61b31163ecd99, daughterB=88c7336e4a3721e3a2e317c575ec50a3 in 778 msec 2023-07-15 19:06:41,172 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/.tmp/cf/3d6366b0c5574307872352e8311be6cf as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf/3d6366b0c5574307872352e8311be6cf 2023-07-15 19:06:41,186 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] throttle.PressureAwareThroughputController(145): ccf7979e0df4996c0dd61b31163ecd99#cf#compaction#5 average throughput is 4.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:41,189 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 88c7336e4a3721e3a2e317c575ec50a3/cf of 88c7336e4a3721e3a2e317c575ec50a3 into 3d6366b0c5574307872352e8311be6cf(size=102.3 K), total size for store is 102.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:41,189 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 88c7336e4a3721e3a2e317c575ec50a3: 2023-07-15 19:06:41,189 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3., storeName=88c7336e4a3721e3a2e317c575ec50a3/cf, priority=15, startTime=1689448001110; duration=0sec 2023-07-15 19:06:41,189 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:41,205 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/.tmp/cf/ef490c52063d422b8a2415be1387aaec as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf/ef490c52063d422b8a2415be1387aaec 2023-07-15 19:06:41,213 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in ccf7979e0df4996c0dd61b31163ecd99/cf of ccf7979e0df4996c0dd61b31163ecd99 into ef490c52063d422b8a2415be1387aaec(size=143.7 K), total size for store is 143.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:41,213 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for ccf7979e0df4996c0dd61b31163ecd99: 2023-07-15 19:06:41,213 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99., storeName=ccf7979e0df4996c0dd61b31163ecd99/cf, priority=15, startTime=1689448001145; duration=0sec 2023-07-15 19:06:41,214 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:41,395 INFO [CheckForSplit] client.TestAdmin1$1(333): Found: [region=testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=9, region=testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=9] 2023-07-15 19:06:41,396 DEBUG [CheckForSplit] client.TestAdmin1$1(338): CheckForSplit thread exited, current region count: 2 2023-07-15 19:06:41,396 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.RSRpcServices(3109): Region has changed on the scanner -6449571020524224509: regionName=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e., scannerRegionName=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e., closing... 2023-07-15 19:06:41,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] ipc.CallRunner(144): callId: 104 service: ClientService methodName: Scan size: 47 connection: 172.31.14.131:53184 deadline: 1689448061396, exception=org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224509: regionName=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e., scannerRegionName=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. 2023-07-15 19:06:41,399 DEBUG [Listener at localhost/45529] client.ScannerCallableWithReplicas(204): Scan with primary region returns org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:228) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:258) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:58) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:124) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:393) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:367) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224509: regionName=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e., scannerRegionName=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:194) ... 11 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224509: regionName=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e., scannerRegionName=testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-15 19:06:41,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:41,425 DEBUG [Listener at localhost/45529] client.ClientScanner(240): Advancing internal scanner to startKey at '\x00\x00\x0D\xAC', inclusive 2023-07-15 19:06:41,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:41,457 DEBUG [Listener at localhost/45529] client.TestAdmin1(366): Properly split on � 2023-07-15 19:06:41,458 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testForceSplit 2023-07-15 19:06:41,458 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testForceSplit 2023-07-15 19:06:41,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testForceSplit 2023-07-15 19:06:41,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=50 2023-07-15 19:06:41,464 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448001464"}]},"ts":"1689448001464"} 2023-07-15 19:06:41,466 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLING in hbase:meta 2023-07-15 19:06:41,468 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testForceSplit to state=DISABLING 2023-07-15 19:06:41,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=88c7336e4a3721e3a2e317c575ec50a3, UNASSIGN}, {pid=52, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=ccf7979e0df4996c0dd61b31163ecd99, UNASSIGN}] 2023-07-15 19:06:41,474 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=88c7336e4a3721e3a2e317c575ec50a3, UNASSIGN 2023-07-15 19:06:41,474 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=ccf7979e0df4996c0dd61b31163ecd99, UNASSIGN 2023-07-15 19:06:41,475 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=88c7336e4a3721e3a2e317c575ec50a3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:41,475 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448001475"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448001475"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448001475"}]},"ts":"1689448001475"} 2023-07-15 19:06:41,476 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ccf7979e0df4996c0dd61b31163ecd99, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:41,476 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448001476"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448001476"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448001476"}]},"ts":"1689448001476"} 2023-07-15 19:06:41,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; CloseRegionProcedure 88c7336e4a3721e3a2e317c575ec50a3, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:41,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure ccf7979e0df4996c0dd61b31163ecd99, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:41,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88c7336e4a3721e3a2e317c575ec50a3, disabling compactions & flushes 2023-07-15 19:06:41,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. after waiting 0 ms 2023-07-15 19:06:41,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,633 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96-top] to archive 2023-07-15 19:06:41,634 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:41,636 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:41,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 19:06:41,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3. 2023-07-15 19:06:41,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88c7336e4a3721e3a2e317c575ec50a3: 2023-07-15 19:06:41,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ccf7979e0df4996c0dd61b31163ecd99, disabling compactions & flushes 2023-07-15 19:06:41,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. after waiting 0 ms 2023-07-15 19:06:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=88c7336e4a3721e3a2e317c575ec50a3, regionState=CLOSED 2023-07-15 19:06:41,648 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448001645"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448001645"}]},"ts":"1689448001645"} 2023-07-15 19:06:41,648 DEBUG [StoreCloser-testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96-bottom] to archive 2023-07-15 19:06:41,649 DEBUG [StoreCloser-testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:41,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-15 19:06:41,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; CloseRegionProcedure 88c7336e4a3721e3a2e317c575ec50a3, server=jenkins-hbase4.apache.org,36223,1689447992001 in 172 msec 2023-07-15 19:06:41,652 DEBUG [StoreCloser-testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf/317f77fc6aeb486495f43defd23b7c96.db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:41,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=88c7336e4a3721e3a2e317c575ec50a3, UNASSIGN in 183 msec 2023-07-15 19:06:41,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 19:06:41,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99. 2023-07-15 19:06:41,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ccf7979e0df4996c0dd61b31163ecd99: 2023-07-15 19:06:41,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,661 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ccf7979e0df4996c0dd61b31163ecd99, regionState=CLOSED 2023-07-15 19:06:41,661 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448001661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448001661"}]},"ts":"1689448001661"} 2023-07-15 19:06:41,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-15 19:06:41,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure ccf7979e0df4996c0dd61b31163ecd99, server=jenkins-hbase4.apache.org,36223,1689447992001 in 186 msec 2023-07-15 19:06:41,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=50 2023-07-15 19:06:41,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=ccf7979e0df4996c0dd61b31163ecd99, UNASSIGN in 196 msec 2023-07-15 19:06:41,668 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448001668"}]},"ts":"1689448001668"} 2023-07-15 19:06:41,669 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLED in hbase:meta 2023-07-15 19:06:41,671 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testForceSplit to state=DISABLED 2023-07-15 19:06:41,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; DisableTableProcedure table=testForceSplit in 214 msec 2023-07-15 19:06:41,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=50 2023-07-15 19:06:41,715 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testForceSplit, procId: 50 completed 2023-07-15 19:06:41,716 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testForceSplit 2023-07-15 19:06:41,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:41,720 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=55, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:41,721 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=55, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:41,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-15 19:06:41,728 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,728 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,728 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:41,730 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/recovered.edits] 2023-07-15 19:06:41,730 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/recovered.edits] 2023-07-15 19:06:41,731 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/recovered.edits] 2023-07-15 19:06:41,735 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf/ef490c52063d422b8a2415be1387aaec to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/cf/ef490c52063d422b8a2415be1387aaec 2023-07-15 19:06:41,735 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf/3d6366b0c5574307872352e8311be6cf to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/cf/3d6366b0c5574307872352e8311be6cf 2023-07-15 19:06:41,737 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/cf/317f77fc6aeb486495f43defd23b7c96 2023-07-15 19:06:41,740 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/recovered.edits/12.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3/recovered.edits/12.seqid 2023-07-15 19:06:41,740 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/recovered.edits/12.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99/recovered.edits/12.seqid 2023-07-15 19:06:41,741 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/88c7336e4a3721e3a2e317c575ec50a3 2023-07-15 19:06:41,741 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ccf7979e0df4996c0dd61b31163ecd99 2023-07-15 19:06:41,742 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/recovered.edits/8.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e/recovered.edits/8.seqid 2023-07-15 19:06:41,743 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/db2b074b0ac92c3cbda8af48c0af328e 2023-07-15 19:06:41,743 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:41,746 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=55, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:41,750 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testForceSplit from hbase:meta 2023-07-15 19:06:41,752 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testForceSplit' descriptor. 2023-07-15 19:06:41,753 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=55, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:41,753 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testForceSplit' from region states. 2023-07-15 19:06:41,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448001753"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:41,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448001753"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:41,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448001753"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:41,756 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-15 19:06:41,756 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 88c7336e4a3721e3a2e317c575ec50a3, NAME => 'testForceSplit,\x00\x00\x0D\xAC,1689448000387.88c7336e4a3721e3a2e317c575ec50a3.', STARTKEY => '\x00\x00\x0D\xAC', ENDKEY => ''}, {ENCODED => db2b074b0ac92c3cbda8af48c0af328e, NAME => 'testForceSplit,,1689447999492.db2b074b0ac92c3cbda8af48c0af328e.', STARTKEY => '', ENDKEY => ''}, {ENCODED => ccf7979e0df4996c0dd61b31163ecd99, NAME => 'testForceSplit,,1689448000387.ccf7979e0df4996c0dd61b31163ecd99.', STARTKEY => '', ENDKEY => '\x00\x00\x0D\xAC'}] 2023-07-15 19:06:41,756 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testForceSplit' as deleted. 2023-07-15 19:06:41,756 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448001756"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:41,758 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testForceSplit state from META 2023-07-15 19:06:41,761 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=55, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:41,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; DeleteTableProcedure table=testForceSplit in 45 msec 2023-07-15 19:06:41,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-15 19:06:41,973 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testForceSplit, procId: 55 completed 2023-07-15 19:06:41,976 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf must be between 1K and 16MB. 2023-07-15 19:06:41,977 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testForceSplit', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:41,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testForceSplit 2023-07-15 19:06:41,983 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=56, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:41,983 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testForceSplit" procId is: 56 2023-07-15 19:06:41,984 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=56, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:41,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 19:06:41,986 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:41,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e empty. 2023-07-15 19:06:41,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:41,987 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:42,029 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:42,031 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2141d340f4eae9868c7a1525bac9d55e, NAME => 'testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testForceSplit', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:42,054 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:42,054 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1604): Closing 2141d340f4eae9868c7a1525bac9d55e, disabling compactions & flushes 2023-07-15 19:06:42,054 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,054 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,054 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. after waiting 0 ms 2023-07-15 19:06:42,054 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,054 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,055 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1558): Region close journal for 2141d340f4eae9868c7a1525bac9d55e: 2023-07-15 19:06:42,057 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=56, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:42,059 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448002059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448002059"}]},"ts":"1689448002059"} 2023-07-15 19:06:42,064 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:42,065 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=56, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:42,065 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448002065"}]},"ts":"1689448002065"} 2023-07-15 19:06:42,066 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLING in hbase:meta 2023-07-15 19:06:42,074 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:42,075 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:42,075 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:42,075 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:42,075 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:42,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=2141d340f4eae9868c7a1525bac9d55e, ASSIGN}] 2023-07-15 19:06:42,078 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=57, ppid=56, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=2141d340f4eae9868c7a1525bac9d55e, ASSIGN 2023-07-15 19:06:42,079 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=57, ppid=56, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=2141d340f4eae9868c7a1525bac9d55e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:42,229 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:42,231 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=57 updating hbase:meta row=2141d340f4eae9868c7a1525bac9d55e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:42,231 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448002231"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448002231"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448002231"}]},"ts":"1689448002231"} 2023-07-15 19:06:42,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE; OpenRegionProcedure 2141d340f4eae9868c7a1525bac9d55e, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:42,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 19:06:42,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2141d340f4eae9868c7a1525bac9d55e, NAME => 'testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:42,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:42,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:42,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:42,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:42,391 INFO [StoreOpener-2141d340f4eae9868c7a1525bac9d55e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:42,393 DEBUG [StoreOpener-2141d340f4eae9868c7a1525bac9d55e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf 2023-07-15 19:06:42,393 DEBUG [StoreOpener-2141d340f4eae9868c7a1525bac9d55e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf 2023-07-15 19:06:42,393 INFO [StoreOpener-2141d340f4eae9868c7a1525bac9d55e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2141d340f4eae9868c7a1525bac9d55e columnFamilyName cf 2023-07-15 19:06:42,394 INFO [StoreOpener-2141d340f4eae9868c7a1525bac9d55e-1] regionserver.HStore(310): Store=2141d340f4eae9868c7a1525bac9d55e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:42,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:42,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:42,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:42,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:42,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2141d340f4eae9868c7a1525bac9d55e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66261110, jitterRate=-0.012632519006729126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:42,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2141d340f4eae9868c7a1525bac9d55e: 2023-07-15 19:06:42,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e., pid=58, masterSystemTime=1689448002385 2023-07-15 19:06:42,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,404 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=57 updating hbase:meta row=2141d340f4eae9868c7a1525bac9d55e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:42,404 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448002404"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448002404"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448002404"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448002404"}]},"ts":"1689448002404"} 2023-07-15 19:06:42,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-15 19:06:42,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; OpenRegionProcedure 2141d340f4eae9868c7a1525bac9d55e, server=jenkins-hbase4.apache.org,36223,1689447992001 in 173 msec 2023-07-15 19:06:42,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-07-15 19:06:42,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=2141d340f4eae9868c7a1525bac9d55e, ASSIGN in 332 msec 2023-07-15 19:06:42,411 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=56, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:42,411 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448002411"}]},"ts":"1689448002411"} 2023-07-15 19:06:42,412 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLED in hbase:meta 2023-07-15 19:06:42,416 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=56, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:42,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; CreateTableProcedure table=testForceSplit in 439 msec 2023-07-15 19:06:42,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 19:06:42,737 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testForceSplit, procId: 56 completed 2023-07-15 19:06:42,738 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testForceSplit get assigned. Timeout = 60000ms 2023-07-15 19:06:42,738 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:42,740 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testForceSplit assigned to meta. Checking AM states. 2023-07-15 19:06:42,740 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:42,741 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testForceSplit assigned. 2023-07-15 19:06:42,769 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6000 Client: jenkins//172.31.14.131 first region in multi=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,824 INFO [Listener at localhost/45529] client.TestAdmin1(291): Initial regions (1): [region=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=2] 2023-07-15 19:06:42,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:42,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:42,853 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:42,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:42,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=2141d340f4eae9868c7a1525bac9d55e, daughterA=f660e77bd919b2a842dee75d71b9444a, daughterB=a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:42,857 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=2141d340f4eae9868c7a1525bac9d55e, daughterA=f660e77bd919b2a842dee75d71b9444a, daughterB=a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:42,857 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=2141d340f4eae9868c7a1525bac9d55e, daughterA=f660e77bd919b2a842dee75d71b9444a, daughterB=a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:42,857 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=2141d340f4eae9868c7a1525bac9d55e, daughterA=f660e77bd919b2a842dee75d71b9444a, daughterB=a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:42,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-07-15 19:06:42,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=2141d340f4eae9868c7a1525bac9d55e, UNASSIGN}] 2023-07-15 19:06:42,861 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=60, ppid=59, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=2141d340f4eae9868c7a1525bac9d55e, UNASSIGN 2023-07-15 19:06:42,863 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=60 updating hbase:meta row=2141d340f4eae9868c7a1525bac9d55e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:42,863 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448002863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448002863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448002863"}]},"ts":"1689448002863"} 2023-07-15 19:06:42,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE; CloseRegionProcedure 2141d340f4eae9868c7a1525bac9d55e, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:43,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:43,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2141d340f4eae9868c7a1525bac9d55e, disabling compactions & flushes 2023-07-15 19:06:43,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:43,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:43,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. after waiting 0 ms 2023-07-15 19:06:43,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:43,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2141d340f4eae9868c7a1525bac9d55e 1/1 column families, dataSize=175.78 KB heapSize=609.63 KB 2023-07-15 19:06:43,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=175.78 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/.tmp/cf/1bb544f9483c43159f0074e493763d3c 2023-07-15 19:06:43,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/.tmp/cf/1bb544f9483c43159f0074e493763d3c as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c 2023-07-15 19:06:43,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c, entries=6000, sequenceid=5, filesize=237.3 K 2023-07-15 19:06:43,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~175.78 KB/180000, heapSize ~609.61 KB/624240, currentSize=0 B/0 for 2141d340f4eae9868c7a1525bac9d55e in 44ms, sequenceid=5, compaction requested=false 2023-07-15 19:06:43,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 19:06:43,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:43,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2141d340f4eae9868c7a1525bac9d55e: 2023-07-15 19:06:43,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:43,072 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=60 updating hbase:meta row=2141d340f4eae9868c7a1525bac9d55e, regionState=CLOSED 2023-07-15 19:06:43,073 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448003072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448003072"}]},"ts":"1689448003072"} 2023-07-15 19:06:43,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-07-15 19:06:43,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; CloseRegionProcedure 2141d340f4eae9868c7a1525bac9d55e, server=jenkins-hbase4.apache.org,36223,1689447992001 in 209 msec 2023-07-15 19:06:43,078 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-15 19:06:43,078 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=2141d340f4eae9868c7a1525bac9d55e, UNASSIGN in 217 msec 2023-07-15 19:06:43,087 INFO [PEWorker-1] assignment.SplitTableRegionProcedure(694): pid=59 splitting 1 storefiles, region=2141d340f4eae9868c7a1525bac9d55e, threads=1 2023-07-15 19:06:43,087 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=59 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c for region: 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:43,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-07-15 19:06:43,148 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=59 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c for region: 2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:43,149 DEBUG [PEWorker-1] assignment.SplitTableRegionProcedure(755): pid=59 split storefiles for region 2141d340f4eae9868c7a1525bac9d55e Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-15 19:06:43,185 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 19:06:43,187 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 19:06:43,189 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448003188"},{"qualifier":"splitA","vlen":52,"tag":[],"timestamp":"1689448003188"},{"qualifier":"splitB","vlen":52,"tag":[],"timestamp":"1689448003188"}]},"ts":"1689448003188"} 2023-07-15 19:06:43,189 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448003188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448003188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448003188"}]},"ts":"1689448003188"} 2023-07-15 19:06:43,189 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448003188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448003188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448003188"}]},"ts":"1689448003188"} 2023-07-15 19:06:43,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=59, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=f660e77bd919b2a842dee75d71b9444a, ASSIGN}, {pid=63, ppid=59, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=a5ad6bfb5dcb8b107eeaa31137a98481, ASSIGN}] 2023-07-15 19:06:43,193 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=63, ppid=59, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=a5ad6bfb5dcb8b107eeaa31137a98481, ASSIGN 2023-07-15 19:06:43,193 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=62, ppid=59, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=f660e77bd919b2a842dee75d71b9444a, ASSIGN 2023-07-15 19:06:43,194 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=63, ppid=59, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=a5ad6bfb5dcb8b107eeaa31137a98481, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:43,194 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=62, ppid=59, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=f660e77bd919b2a842dee75d71b9444a, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:43,345 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 19:06:43,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=62 updating hbase:meta row=f660e77bd919b2a842dee75d71b9444a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:43,347 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=63 updating hbase:meta row=a5ad6bfb5dcb8b107eeaa31137a98481, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:43,347 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448003347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448003347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448003347"}]},"ts":"1689448003347"} 2023-07-15 19:06:43,347 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448003347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448003347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448003347"}]},"ts":"1689448003347"} 2023-07-15 19:06:43,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE; OpenRegionProcedure a5ad6bfb5dcb8b107eeaa31137a98481, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:43,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=62, state=RUNNABLE; OpenRegionProcedure f660e77bd919b2a842dee75d71b9444a, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:43,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:43,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f660e77bd919b2a842dee75d71b9444a, NAME => 'testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.', STARTKEY => '', ENDKEY => '\x00\x00\x0D\xAC'} 2023-07-15 19:06:43,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:43,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:43,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:43,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:43,506 INFO [StoreOpener-f660e77bd919b2a842dee75d71b9444a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:43,507 DEBUG [StoreOpener-f660e77bd919b2a842dee75d71b9444a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf 2023-07-15 19:06:43,508 DEBUG [StoreOpener-f660e77bd919b2a842dee75d71b9444a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf 2023-07-15 19:06:43,508 INFO [StoreOpener-f660e77bd919b2a842dee75d71b9444a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f660e77bd919b2a842dee75d71b9444a columnFamilyName cf 2023-07-15 19:06:43,518 DEBUG [StoreOpener-f660e77bd919b2a842dee75d71b9444a-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c-bottom 2023-07-15 19:06:43,518 INFO [StoreOpener-f660e77bd919b2a842dee75d71b9444a-1] regionserver.HStore(310): Store=f660e77bd919b2a842dee75d71b9444a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:43,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:43,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:43,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:43,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f660e77bd919b2a842dee75d71b9444a; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65680646, jitterRate=-0.021282106637954712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:43,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f660e77bd919b2a842dee75d71b9444a: 2023-07-15 19:06:43,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a., pid=65, masterSystemTime=1689448003500 2023-07-15 19:06:43,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:43,526 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:43,527 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:43,527 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1912): f660e77bd919b2a842dee75d71b9444a/cf is initiating minor compaction (all files) 2023-07-15 19:06:43,527 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f660e77bd919b2a842dee75d71b9444a/cf in testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:43,527 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c-bottom] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/.tmp, totalSize=237.3 K 2023-07-15 19:06:43,528 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] compactions.Compactor(207): Compacting 1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e, keycount=3000, bloomtype=ROW, size=237.3 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689448002787 2023-07-15 19:06:43,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:43,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:43,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5ad6bfb5dcb8b107eeaa31137a98481, NAME => 'testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.', STARTKEY => '\x00\x00\x0D\xAC', ENDKEY => ''} 2023-07-15 19:06:43,529 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=62 updating hbase:meta row=f660e77bd919b2a842dee75d71b9444a, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:43,529 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448003529"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448003529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448003529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448003529"}]},"ts":"1689448003529"} 2023-07-15 19:06:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:43,531 INFO [StoreOpener-a5ad6bfb5dcb8b107eeaa31137a98481-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:43,533 DEBUG [StoreOpener-a5ad6bfb5dcb8b107eeaa31137a98481-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf 2023-07-15 19:06:43,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=62 2023-07-15 19:06:43,533 DEBUG [StoreOpener-a5ad6bfb5dcb8b107eeaa31137a98481-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf 2023-07-15 19:06:43,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=62, state=SUCCESS; OpenRegionProcedure f660e77bd919b2a842dee75d71b9444a, server=jenkins-hbase4.apache.org,36223,1689447992001 in 182 msec 2023-07-15 19:06:43,534 INFO [StoreOpener-a5ad6bfb5dcb8b107eeaa31137a98481-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5ad6bfb5dcb8b107eeaa31137a98481 columnFamilyName cf 2023-07-15 19:06:43,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=59, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=f660e77bd919b2a842dee75d71b9444a, ASSIGN in 341 msec 2023-07-15 19:06:43,544 DEBUG [StoreOpener-a5ad6bfb5dcb8b107eeaa31137a98481-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c-top 2023-07-15 19:06:43,544 INFO [StoreOpener-a5ad6bfb5dcb8b107eeaa31137a98481-1] regionserver.HStore(310): Store=a5ad6bfb5dcb8b107eeaa31137a98481/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:43,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:43,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:43,547 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] throttle.PressureAwareThroughputController(145): f660e77bd919b2a842dee75d71b9444a#cf#compaction#7 average throughput is 7.70 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:43,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:43,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a5ad6bfb5dcb8b107eeaa31137a98481; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66672320, jitterRate=-0.006505012512207031}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:43,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a5ad6bfb5dcb8b107eeaa31137a98481: 2023-07-15 19:06:43,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481., pid=64, masterSystemTime=1689448003500 2023-07-15 19:06:43,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-15 19:06:43,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:43,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:43,555 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=63 updating hbase:meta row=a5ad6bfb5dcb8b107eeaa31137a98481, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:43,555 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448003554"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448003554"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448003554"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448003554"}]},"ts":"1689448003554"} 2023-07-15 19:06:43,560 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:43,563 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:43,563 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1912): a5ad6bfb5dcb8b107eeaa31137a98481/cf is initiating minor compaction (all files) 2023-07-15 19:06:43,563 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a5ad6bfb5dcb8b107eeaa31137a98481/cf in testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:43,563 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c-top] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/.tmp, totalSize=237.3 K 2023-07-15 19:06:43,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-15 19:06:43,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; OpenRegionProcedure a5ad6bfb5dcb8b107eeaa31137a98481, server=jenkins-hbase4.apache.org,36223,1689447992001 in 210 msec 2023-07-15 19:06:43,564 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] compactions.Compactor(207): Compacting 1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e, keycount=3000, bloomtype=ROW, size=237.3 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689448002787 2023-07-15 19:06:43,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=59 2023-07-15 19:06:43,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=59, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=a5ad6bfb5dcb8b107eeaa31137a98481, ASSIGN in 372 msec 2023-07-15 19:06:43,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; SplitTableRegionProcedure table=testForceSplit, parent=2141d340f4eae9868c7a1525bac9d55e, daughterA=f660e77bd919b2a842dee75d71b9444a, daughterB=a5ad6bfb5dcb8b107eeaa31137a98481 in 711 msec 2023-07-15 19:06:43,580 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/.tmp/cf/1a56dbd7346c47b5af83869545d0102b as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf/1a56dbd7346c47b5af83869545d0102b 2023-07-15 19:06:43,588 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] throttle.PressureAwareThroughputController(145): a5ad6bfb5dcb8b107eeaa31137a98481#cf#compaction#8 average throughput is 5.50 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:43,594 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in f660e77bd919b2a842dee75d71b9444a/cf of f660e77bd919b2a842dee75d71b9444a into 1a56dbd7346c47b5af83869545d0102b(size=143.7 K), total size for store is 143.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:43,594 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f660e77bd919b2a842dee75d71b9444a: 2023-07-15 19:06:43,595 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a., storeName=f660e77bd919b2a842dee75d71b9444a/cf, priority=15, startTime=1689448003525; duration=0sec 2023-07-15 19:06:43,595 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:43,604 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/.tmp/cf/2b39ae2e228e4008bce8d474398b1362 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf/2b39ae2e228e4008bce8d474398b1362 2023-07-15 19:06:43,612 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in a5ad6bfb5dcb8b107eeaa31137a98481/cf of a5ad6bfb5dcb8b107eeaa31137a98481 into 2b39ae2e228e4008bce8d474398b1362(size=102.3 K), total size for store is 102.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:43,612 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a5ad6bfb5dcb8b107eeaa31137a98481: 2023-07-15 19:06:43,612 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481., storeName=a5ad6bfb5dcb8b107eeaa31137a98481/cf, priority=15, startTime=1689448003552; duration=0sec 2023-07-15 19:06:43,612 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:43,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-07-15 19:06:43,615 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: SPLIT_REGION, Table Name: default:testForceSplit, procId: 59 completed 2023-07-15 19:06:43,616 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.RSRpcServices(3109): Region has changed on the scanner -6449571020524224505: regionName=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e., scannerRegionName=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e., closing... 2023-07-15 19:06:43,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Scan size: 48 connection: 172.31.14.131:53184 deadline: 1689448063616, exception=org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224505: regionName=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e., scannerRegionName=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. 2023-07-15 19:06:43,619 DEBUG [Listener at localhost/45529] client.ScannerCallableWithReplicas(204): Scan with primary region returns org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:228) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:258) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:58) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:124) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:393) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:367) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224505: regionName=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e., scannerRegionName=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:194) ... 11 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224505: regionName=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e., scannerRegionName=testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-15 19:06:43,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] ipc.CallRunner(144): callId: 149 service: ClientService methodName: Scan size: 148 connection: 172.31.14.131:53184 deadline: 1689448063622, exception=org.apache.hadoop.hbase.NotServingRegionException: testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e. is not online on jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:43,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:43,906 DEBUG [Listener at localhost/45529] client.ClientScanner(240): Advancing internal scanner to startKey at '\x00\x00\x0D\xAC', inclusive 2023-07-15 19:06:43,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1054 bytes) of cf 2023-07-15 19:06:43,937 DEBUG [Listener at localhost/45529] client.TestAdmin1(366): Properly split on � 2023-07-15 19:06:43,938 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testForceSplit 2023-07-15 19:06:43,938 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testForceSplit 2023-07-15 19:06:43,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testForceSplit 2023-07-15 19:06:43,943 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448003943"}]},"ts":"1689448003943"} 2023-07-15 19:06:43,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 19:06:43,945 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLING in hbase:meta 2023-07-15 19:06:43,948 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testForceSplit to state=DISABLING 2023-07-15 19:06:43,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=a5ad6bfb5dcb8b107eeaa31137a98481, UNASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=f660e77bd919b2a842dee75d71b9444a, UNASSIGN}] 2023-07-15 19:06:43,951 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=a5ad6bfb5dcb8b107eeaa31137a98481, UNASSIGN 2023-07-15 19:06:43,951 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=f660e77bd919b2a842dee75d71b9444a, UNASSIGN 2023-07-15 19:06:43,952 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a5ad6bfb5dcb8b107eeaa31137a98481, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:43,952 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448003952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448003952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448003952"}]},"ts":"1689448003952"} 2023-07-15 19:06:43,953 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f660e77bd919b2a842dee75d71b9444a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:43,953 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448003952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448003952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448003952"}]},"ts":"1689448003952"} 2023-07-15 19:06:43,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; CloseRegionProcedure a5ad6bfb5dcb8b107eeaa31137a98481, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:43,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; CloseRegionProcedure f660e77bd919b2a842dee75d71b9444a, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:44,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:44,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f660e77bd919b2a842dee75d71b9444a, disabling compactions & flushes 2023-07-15 19:06:44,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:44,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:44,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. after waiting 0 ms 2023-07-15 19:06:44,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:44,111 DEBUG [StoreCloser-testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c-bottom] to archive 2023-07-15 19:06:44,112 DEBUG [StoreCloser-testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:44,115 DEBUG [StoreCloser-testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:44,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 19:06:44,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a. 2023-07-15 19:06:44,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f660e77bd919b2a842dee75d71b9444a: 2023-07-15 19:06:44,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:44,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:44,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a5ad6bfb5dcb8b107eeaa31137a98481, disabling compactions & flushes 2023-07-15 19:06:44,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:44,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:44,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. after waiting 0 ms 2023-07-15 19:06:44,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:44,128 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f660e77bd919b2a842dee75d71b9444a, regionState=CLOSED 2023-07-15 19:06:44,130 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448004128"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448004128"}]},"ts":"1689448004128"} 2023-07-15 19:06:44,130 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c-top] to archive 2023-07-15 19:06:44,132 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:44,134 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf/1bb544f9483c43159f0074e493763d3c.2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:44,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-15 19:06:44,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; CloseRegionProcedure f660e77bd919b2a842dee75d71b9444a, server=jenkins-hbase4.apache.org,36223,1689447992001 in 177 msec 2023-07-15 19:06:44,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=f660e77bd919b2a842dee75d71b9444a, UNASSIGN in 190 msec 2023-07-15 19:06:44,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 19:06:44,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481. 2023-07-15 19:06:44,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a5ad6bfb5dcb8b107eeaa31137a98481: 2023-07-15 19:06:44,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:44,147 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a5ad6bfb5dcb8b107eeaa31137a98481, regionState=CLOSED 2023-07-15 19:06:44,147 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448004147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448004147"}]},"ts":"1689448004147"} 2023-07-15 19:06:44,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-15 19:06:44,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; CloseRegionProcedure a5ad6bfb5dcb8b107eeaa31137a98481, server=jenkins-hbase4.apache.org,36223,1689447992001 in 195 msec 2023-07-15 19:06:44,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-15 19:06:44,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=a5ad6bfb5dcb8b107eeaa31137a98481, UNASSIGN in 203 msec 2023-07-15 19:06:44,162 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448004162"}]},"ts":"1689448004162"} 2023-07-15 19:06:44,163 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLED in hbase:meta 2023-07-15 19:06:44,166 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testForceSplit to state=DISABLED 2023-07-15 19:06:44,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; DisableTableProcedure table=testForceSplit in 229 msec 2023-07-15 19:06:44,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 19:06:44,196 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testForceSplit, procId: 66 completed 2023-07-15 19:06:44,196 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testForceSplit 2023-07-15 19:06:44,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:44,199 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=71, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:44,200 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=71, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:44,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 19:06:44,205 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:44,206 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:44,206 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:44,208 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/recovered.edits] 2023-07-15 19:06:44,208 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/recovered.edits] 2023-07-15 19:06:44,208 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/recovered.edits] 2023-07-15 19:06:44,212 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf/2b39ae2e228e4008bce8d474398b1362 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/cf/2b39ae2e228e4008bce8d474398b1362 2023-07-15 19:06:44,212 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf/1a56dbd7346c47b5af83869545d0102b to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/cf/1a56dbd7346c47b5af83869545d0102b 2023-07-15 19:06:44,213 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/cf/1bb544f9483c43159f0074e493763d3c 2023-07-15 19:06:44,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/recovered.edits/12.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a/recovered.edits/12.seqid 2023-07-15 19:06:44,216 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/recovered.edits/12.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481/recovered.edits/12.seqid 2023-07-15 19:06:44,217 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/f660e77bd919b2a842dee75d71b9444a 2023-07-15 19:06:44,217 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a5ad6bfb5dcb8b107eeaa31137a98481 2023-07-15 19:06:44,217 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/recovered.edits/8.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e/recovered.edits/8.seqid 2023-07-15 19:06:44,218 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/2141d340f4eae9868c7a1525bac9d55e 2023-07-15 19:06:44,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:44,221 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=71, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:44,223 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testForceSplit from hbase:meta 2023-07-15 19:06:44,226 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testForceSplit' descriptor. 2023-07-15 19:06:44,227 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=71, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:44,227 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testForceSplit' from region states. 2023-07-15 19:06:44,227 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,\\x00\\x00\\x0D\\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448004227"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:44,227 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448004227"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:44,227 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448004227"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:44,229 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-15 19:06:44,229 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a5ad6bfb5dcb8b107eeaa31137a98481, NAME => 'testForceSplit,\x00\x00\x0D\xAC,1689448002854.a5ad6bfb5dcb8b107eeaa31137a98481.', STARTKEY => '\x00\x00\x0D\xAC', ENDKEY => ''}, {ENCODED => 2141d340f4eae9868c7a1525bac9d55e, NAME => 'testForceSplit,,1689448001976.2141d340f4eae9868c7a1525bac9d55e.', STARTKEY => '', ENDKEY => ''}, {ENCODED => f660e77bd919b2a842dee75d71b9444a, NAME => 'testForceSplit,,1689448002854.f660e77bd919b2a842dee75d71b9444a.', STARTKEY => '', ENDKEY => '\x00\x00\x0D\xAC'}] 2023-07-15 19:06:44,229 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testForceSplit' as deleted. 2023-07-15 19:06:44,229 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448004229"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:44,231 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testForceSplit state from META 2023-07-15 19:06:44,234 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=71, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:44,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; DeleteTableProcedure table=testForceSplit in 37 msec 2023-07-15 19:06:44,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 19:06:44,452 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testForceSplit, procId: 71 completed 2023-07-15 19:06:44,469 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testForceSplit Thread=617 (was 607) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:42154 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:38400 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:54154 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-metaLookup-shared--pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-metaLookup-shared--pool-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-metaLookup-shared--pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_5310775_17 at /127.0.0.1:40154 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:33602 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:42361-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:42084 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:38190 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:38446 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:1;jenkins-hbase4:36223-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=752 (was 742) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 292), ProcessCount=170 (was 170), AvailableMemoryMB=5342 (was 5528) 2023-07-15 19:06:44,470 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=617 is superior to 500 2023-07-15 19:06:44,486 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testCompactionTimestamps Thread=617, OpenFileDescriptor=752, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=170, AvailableMemoryMB=5341 2023-07-15 19:06:44,486 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=617 is superior to 500 2023-07-15 19:06:44,487 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionTimestamps', {NAME => 'fam1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:44,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=72, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionTimestamps 2023-07-15 19:06:44,490 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=72, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionTimestamps execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:44,490 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionTimestamps" procId is: 72 2023-07-15 19:06:44,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=72, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionTimestamps execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:44,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=72 2023-07-15 19:06:44,492 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,493 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d empty. 2023-07-15 19:06:44,493 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,494 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionTimestamps regions 2023-07-15 19:06:44,506 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:44,507 INFO [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6a99215c817b1dd9866e13b03277259d, NAME => 'testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testCompactionTimestamps', {NAME => 'fam1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:44,517 DEBUG [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(866): Instantiated testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:44,517 DEBUG [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(1604): Closing 6a99215c817b1dd9866e13b03277259d, disabling compactions & flushes 2023-07-15 19:06:44,517 INFO [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(1626): Closing region testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:44,518 DEBUG [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:44,518 DEBUG [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. after waiting 0 ms 2023-07-15 19:06:44,518 DEBUG [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:44,518 INFO [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(1838): Closed testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:44,518 DEBUG [RegionOpenAndInit-testCompactionTimestamps-pool-0] regionserver.HRegion(1558): Region close journal for 6a99215c817b1dd9866e13b03277259d: 2023-07-15 19:06:44,523 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=72, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionTimestamps execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:44,524 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689448004524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448004524"}]},"ts":"1689448004524"} 2023-07-15 19:06:44,526 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:44,526 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=72, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionTimestamps execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:44,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionTimestamps","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448004526"}]},"ts":"1689448004526"} 2023-07-15 19:06:44,528 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionTimestamps, state=ENABLING in hbase:meta 2023-07-15 19:06:44,533 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:44,533 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:44,533 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:44,533 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:44,534 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:44,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionTimestamps, region=6a99215c817b1dd9866e13b03277259d, ASSIGN}] 2023-07-15 19:06:44,536 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=72, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionTimestamps, region=6a99215c817b1dd9866e13b03277259d, ASSIGN 2023-07-15 19:06:44,536 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=73, ppid=72, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionTimestamps, region=6a99215c817b1dd9866e13b03277259d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:44,687 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:44,688 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6a99215c817b1dd9866e13b03277259d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:44,688 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689448004688"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448004688"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448004688"}]},"ts":"1689448004688"} 2023-07-15 19:06:44,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; OpenRegionProcedure 6a99215c817b1dd9866e13b03277259d, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:44,691 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 19:06:44,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=72 2023-07-15 19:06:44,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:44,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a99215c817b1dd9866e13b03277259d, NAME => 'testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:44,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionTimestamps 6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:44,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,847 INFO [StoreOpener-6a99215c817b1dd9866e13b03277259d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family fam1 of region 6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,848 DEBUG [StoreOpener-6a99215c817b1dd9866e13b03277259d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1 2023-07-15 19:06:44,848 DEBUG [StoreOpener-6a99215c817b1dd9866e13b03277259d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1 2023-07-15 19:06:44,848 INFO [StoreOpener-6a99215c817b1dd9866e13b03277259d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a99215c817b1dd9866e13b03277259d columnFamilyName fam1 2023-07-15 19:06:44,849 INFO [StoreOpener-6a99215c817b1dd9866e13b03277259d-1] regionserver.HStore(310): Store=6a99215c817b1dd9866e13b03277259d/fam1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:44,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:44,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:44,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6a99215c817b1dd9866e13b03277259d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64994084, jitterRate=-0.031512677669525146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:44,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6a99215c817b1dd9866e13b03277259d: 2023-07-15 19:06:44,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d., pid=74, masterSystemTime=1689448004841 2023-07-15 19:06:44,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:44,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:44,857 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6a99215c817b1dd9866e13b03277259d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:44,857 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689448004857"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448004857"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448004857"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448004857"}]},"ts":"1689448004857"} 2023-07-15 19:06:44,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-15 19:06:44,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; OpenRegionProcedure 6a99215c817b1dd9866e13b03277259d, server=jenkins-hbase4.apache.org,36223,1689447992001 in 169 msec 2023-07-15 19:06:44,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-07-15 19:06:44,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; TransitRegionStateProcedure table=testCompactionTimestamps, region=6a99215c817b1dd9866e13b03277259d, ASSIGN in 326 msec 2023-07-15 19:06:44,862 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=72, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionTimestamps execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:44,863 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionTimestamps","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448004863"}]},"ts":"1689448004863"} 2023-07-15 19:06:44,864 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionTimestamps, state=ENABLED in hbase:meta 2023-07-15 19:06:44,867 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=72, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionTimestamps execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:44,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, state=SUCCESS; CreateTableProcedure table=testCompactionTimestamps in 379 msec 2023-07-15 19:06:45,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=72 2023-07-15 19:06:45,244 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionTimestamps, procId: 72 completed 2023-07-15 19:06:45,267 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 19:06:45,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionTimestamps 2023-07-15 19:06:45,275 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionTimestamps' 2023-07-15 19:06:45,275 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:45,276 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionTimestamps' starting 'acquire' 2023-07-15 19:06:45,276 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionTimestamps', kicking off acquire phase on members. 2023-07-15 19:06:45,276 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,276 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,278 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,278 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,278 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,278 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,279 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,279 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 19:06:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:45,280 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:45,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:45,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:45,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:45,283 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:45,283 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:45,283 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:45,283 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:45,283 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:45,283 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:45,284 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:45,283 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:45,285 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:45,285 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:45,285 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42217,1689447992037' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:45,285 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:45,285 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42361,1689447991925' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 19:06:45,291 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 19:06:45,291 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. started... 2023-07-15 19:06:45,292 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6a99215c817b1dd9866e13b03277259d 1/1 column families, dataSize=36 B heapSize=368 B 2023-07-15 19:06:45,293 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,294 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,294 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,294 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:45,294 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,294 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:45,307 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=36 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/4be02dbb1eef4035aaa358ed886b9adf 2023-07-15 19:06:45,313 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/4be02dbb1eef4035aaa358ed886b9adf as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/4be02dbb1eef4035aaa358ed886b9adf 2023-07-15 19:06:45,319 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/4be02dbb1eef4035aaa358ed886b9adf, entries=1, sequenceid=5, filesize=4.8 K 2023-07-15 19:06:45,319 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~36 B/36, heapSize ~352 B/352, currentSize=0 B/0 for 6a99215c817b1dd9866e13b03277259d in 27ms, sequenceid=5, compaction requested=false 2023-07-15 19:06:45,319 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionTimestamps' 2023-07-15 19:06:45,320 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6a99215c817b1dd9866e13b03277259d: 2023-07-15 19:06:45,320 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 19:06:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 19:06:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:45,322 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:45,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure 'testCompactionTimestamps' on coordinator 2023-07-15 19:06:45,325 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionTimestamps' starting 'in-barrier' execution. 2023-07-15 19:06:45,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fb9474e[Count = 0] remaining members to acquire global barrier 2023-07-15 19:06:45,325 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,327 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,327 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,328 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:45,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,36223,1689447992001' in zk 2023-07-15 19:06:45,328 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,42217,1689447992037' in zk 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:45,328 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 19:06:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,42361,1689447991925' in zk 2023-07-15 19:06:45,332 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:45,333 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:45,334 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:45,334 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionTimestamps' member 'jenkins-hbase4.apache.org,36223,1689447992001': 2023-07-15 19:06:45,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' released barrier for procedure'testCompactionTimestamps', counting down latch. Waiting for 0 more 2023-07-15 19:06:45,339 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionTimestamps' execution completed 2023-07-15 19:06:45,339 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 19:06:45,339 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 19:06:45,339 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionTimestamps 2023-07-15 19:06:45,339 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionTimestampsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 19:06:45,342 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,342 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,342 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:45,342 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,342 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,342 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,343 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:45,343 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,344 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,345 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,348 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:45,348 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,349 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,367 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,370 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,371 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,371 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionTimestamps' 2023-07-15 19:06:45,371 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 19:06:45,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,371 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:45,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,374 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionTimestamps'' to complete. (max 50000 ms per retry) 2023-07-15 19:06:45,374 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 19:06:45,624 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 19:06:45,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-15 19:06:45,641 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 19:06:45,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(143): Procedure testCompactionTimestamps was in running list but was completed. Accepting new attempt. 2023-07-15 19:06:45,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionTimestamps 2023-07-15 19:06:45,643 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionTimestamps' 2023-07-15 19:06:45,643 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:45,644 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionTimestamps' starting 'acquire' 2023-07-15 19:06:45,644 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionTimestamps', kicking off acquire phase on members. 2023-07-15 19:06:45,645 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,645 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,647 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,647 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,647 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,647 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,647 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,647 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 19:06:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,648 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:45,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:45,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:45,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:45,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:45,649 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:45,649 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:45,649 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:45,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:45,650 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:45,649 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:45,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:45,650 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:45,650 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 19:06:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 19:06:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:45,652 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:45,652 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:45,651 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:45,652 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42361,1689447991925' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:45,652 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. started... 2023-07-15 19:06:45,652 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:45,652 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42217,1689447992037' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:45,652 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6a99215c817b1dd9866e13b03277259d 1/1 column families, dataSize=36 B heapSize=368 B 2023-07-15 19:06:45,655 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,656 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,656 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,656 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:45,656 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,656 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:45,664 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=36 B at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/8ee632ad6c924551bc5c316c42df4798 2023-07-15 19:06:45,670 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/8ee632ad6c924551bc5c316c42df4798 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/8ee632ad6c924551bc5c316c42df4798 2023-07-15 19:06:45,675 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/8ee632ad6c924551bc5c316c42df4798, entries=1, sequenceid=9, filesize=4.8 K 2023-07-15 19:06:45,676 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~36 B/36, heapSize ~352 B/352, currentSize=0 B/0 for 6a99215c817b1dd9866e13b03277259d in 24ms, sequenceid=9, compaction requested=false 2023-07-15 19:06:45,677 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6a99215c817b1dd9866e13b03277259d: 2023-07-15 19:06:45,677 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:45,677 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 19:06:45,677 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 19:06:45,677 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,677 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:45,678 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:45,681 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,681 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:45,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:45,681 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,681 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:45,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:45,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:45,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:45,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure 'testCompactionTimestamps' on coordinator 2023-07-15 19:06:45,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@335f7ab3[Count = 0] remaining members to acquire global barrier 2023-07-15 19:06:45,684 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionTimestamps' starting 'in-barrier' execution. 2023-07-15 19:06:45,684 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:45,686 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,686 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 19:06:45,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:45,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,36223,1689447992001' in zk 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:45,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,42217,1689447992037' in zk 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,42361,1689447991925' in zk 2023-07-15 19:06:45,689 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,689 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:45,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:45,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:45,689 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:45,689 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:45,691 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:45,691 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:45,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:45,691 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:45,691 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:45,691 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:45,692 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:45,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionTimestamps' member 'jenkins-hbase4.apache.org,36223,1689447992001': 2023-07-15 19:06:45,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' released barrier for procedure'testCompactionTimestamps', counting down latch. Waiting for 0 more 2023-07-15 19:06:45,696 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionTimestamps' execution completed 2023-07-15 19:06:45,696 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 19:06:45,696 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 19:06:45,696 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionTimestamps 2023-07-15 19:06:45,696 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionTimestampsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 19:06:45,699 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,699 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,699 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,699 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,699 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,699 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:45,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,700 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,700 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:45,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,701 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,701 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:45,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:45,704 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:45,704 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,704 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,713 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,713 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,713 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,713 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,713 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,713 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,713 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,714 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionTimestamps' 2023-07-15 19:06:45,714 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 19:06:45,713 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:45,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,714 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:45,714 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,713 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:45,714 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionTimestamps'' to complete. (max 50000 ms per retry) 2023-07-15 19:06:45,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,715 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 19:06:45,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,714 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:45,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:45,714 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:45,715 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,715 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,715 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:45,715 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:45,715 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:45,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:45,965 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 19:06:45,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-15 19:06:45,968 DEBUG [Listener at localhost/45529] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-15 19:06:45,968 DEBUG [Listener at localhost/45529] regionserver.HStore(1912): 6a99215c817b1dd9866e13b03277259d/fam1 is initiating major compaction (all files) 2023-07-15 19:06:45,968 INFO [Listener at localhost/45529] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 19:06:45,968 INFO [Listener at localhost/45529] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 19:06:45,969 INFO [Listener at localhost/45529] regionserver.HRegion(2259): Starting compaction of 6a99215c817b1dd9866e13b03277259d/fam1 in testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:45,969 INFO [Listener at localhost/45529] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/4be02dbb1eef4035aaa358ed886b9adf, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/8ee632ad6c924551bc5c316c42df4798] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp, totalSize=9.5 K 2023-07-15 19:06:45,970 DEBUG [Listener at localhost/45529] compactions.Compactor(207): Compacting 4be02dbb1eef4035aaa358ed886b9adf, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689448005254 2023-07-15 19:06:45,970 DEBUG [Listener at localhost/45529] compactions.Compactor(207): Compacting 8ee632ad6c924551bc5c316c42df4798, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689448005638 2023-07-15 19:06:45,978 INFO [Listener at localhost/45529] throttle.PressureAwareThroughputController(145): 6a99215c817b1dd9866e13b03277259d#fam1#compaction#11 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:45,991 DEBUG [Listener at localhost/45529] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/0eea39b621974925a4e10739f934a131 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/0eea39b621974925a4e10739f934a131 2023-07-15 19:06:45,997 INFO [Listener at localhost/45529] regionserver.HStore(1652): Completed major compaction of 2 (all) file(s) in 6a99215c817b1dd9866e13b03277259d/fam1 of 6a99215c817b1dd9866e13b03277259d into 0eea39b621974925a4e10739f934a131(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:45,997 DEBUG [Listener at localhost/45529] regionserver.HRegion(2289): Compaction status journal for 6a99215c817b1dd9866e13b03277259d: 2023-07-15 19:06:46,002 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 19:06:46,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(143): Procedure testCompactionTimestamps was in running list but was completed. Accepting new attempt. 2023-07-15 19:06:46,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionTimestamps 2023-07-15 19:06:46,003 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionTimestamps' 2023-07-15 19:06:46,004 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:46,005 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionTimestamps' starting 'acquire' 2023-07-15 19:06:46,005 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionTimestamps', kicking off acquire phase on members. 2023-07-15 19:06:46,005 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,005 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,007 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,007 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,007 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,007 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,008 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,008 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:46,009 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:46,009 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:46,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:46,009 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:46,009 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:46,009 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:46,010 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:46,010 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:46,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:46,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:46,010 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:46,010 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:46,010 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:46,010 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:46,010 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:46,011 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:46,010 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42361,1689447991925' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:46,012 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:46,012 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:46,012 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42217,1689447992037' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:46,012 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 19:06:46,012 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 19:06:46,012 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:46,012 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. started... 2023-07-15 19:06:46,012 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6a99215c817b1dd9866e13b03277259d 1/1 column families, dataSize=36 B heapSize=368 B 2023-07-15 19:06:46,015 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,015 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,015 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,015 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:46,015 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,015 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:46,026 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=36 B at sequenceid=14 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/ff17b0255c7c4c1aab6a43fe849b804b 2023-07-15 19:06:46,031 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/ff17b0255c7c4c1aab6a43fe849b804b as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/ff17b0255c7c4c1aab6a43fe849b804b 2023-07-15 19:06:46,036 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/ff17b0255c7c4c1aab6a43fe849b804b, entries=1, sequenceid=14, filesize=4.8 K 2023-07-15 19:06:46,037 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~36 B/36, heapSize ~352 B/352, currentSize=0 B/0 for 6a99215c817b1dd9866e13b03277259d in 25ms, sequenceid=14, compaction requested=false 2023-07-15 19:06:46,037 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6a99215c817b1dd9866e13b03277259d: 2023-07-15 19:06:46,037 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 19:06:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 19:06:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:46,040 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,040 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:46,040 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,040 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:46,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure 'testCompactionTimestamps' on coordinator 2023-07-15 19:06:46,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@318a1189[Count = 0] remaining members to acquire global barrier 2023-07-15 19:06:46,043 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionTimestamps' starting 'in-barrier' execution. 2023-07-15 19:06:46,044 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,045 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,045 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,045 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:46,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:46,046 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:46,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,046 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,046 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 19:06:46,046 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,42217,1689447992037' in zk 2023-07-15 19:06:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,36223,1689447992001' in zk 2023-07-15 19:06:46,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,046 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:46,046 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:46,046 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,42361,1689447991925' in zk 2023-07-15 19:06:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:46,053 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:46,053 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:46,053 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:46,053 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,053 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:46,053 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:46,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:46,054 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionTimestamps' member 'jenkins-hbase4.apache.org,36223,1689447992001': 2023-07-15 19:06:46,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' released barrier for procedure'testCompactionTimestamps', counting down latch. Waiting for 0 more 2023-07-15 19:06:46,060 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionTimestamps' execution completed 2023-07-15 19:06:46,060 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 19:06:46,060 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 19:06:46,060 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionTimestamps 2023-07-15 19:06:46,060 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionTimestampsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 19:06:46,062 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,062 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,062 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,062 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:46,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,062 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,062 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,063 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,064 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:46,064 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,065 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,067 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,068 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,068 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,072 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionTimestamps' 2023-07-15 19:06:46,072 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,073 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,073 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,073 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionTimestamps'' to complete. (max 50000 ms per retry) 2023-07-15 19:06:46,072 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,073 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 19:06:46,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,073 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,072 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:46,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,073 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,075 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,075 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,075 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,075 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,323 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 19:06:46,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-15 19:06:46,330 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 19:06:46,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(143): Procedure testCompactionTimestamps was in running list but was completed. Accepting new attempt. 2023-07-15 19:06:46,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionTimestamps 2023-07-15 19:06:46,335 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionTimestamps' 2023-07-15 19:06:46,335 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:46,336 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionTimestamps' starting 'acquire' 2023-07-15 19:06:46,336 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionTimestamps', kicking off acquire phase on members. 2023-07-15 19:06:46,336 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,336 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,338 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,338 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,338 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,338 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,338 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,338 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 19:06:46,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:46,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionTimestamps 2023-07-15 19:06:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:46,340 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:46,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42217,1689447992037' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:46,340 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionTimestamps is still present, removing 2023-07-15 19:06:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:46,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionTimestamps 2023-07-15 19:06:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42361,1689447991925' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionTimestamps' with timeout 60000ms 2023-07-15 19:06:46,341 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:46,342 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionTimestamps' starting 'acquire' stage 2023-07-15 19:06:46,342 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 19:06:46,342 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 19:06:46,342 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:46,342 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. started... 2023-07-15 19:06:46,343 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6a99215c817b1dd9866e13b03277259d 1/1 column families, dataSize=36 B heapSize=368 B 2023-07-15 19:06:46,343 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,345 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,345 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,346 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:46,346 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,346 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:46,353 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=36 B at sequenceid=18 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/32cc4f91fa294583a8327f0b9874c94b 2023-07-15 19:06:46,359 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/.tmp/fam1/32cc4f91fa294583a8327f0b9874c94b as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/32cc4f91fa294583a8327f0b9874c94b 2023-07-15 19:06:46,364 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/32cc4f91fa294583a8327f0b9874c94b, entries=1, sequenceid=18, filesize=4.8 K 2023-07-15 19:06:46,364 INFO [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~36 B/36, heapSize ~352 B/352, currentSize=0 B/0 for 6a99215c817b1dd9866e13b03277259d in 22ms, sequenceid=18, compaction requested=true 2023-07-15 19:06:46,365 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6a99215c817b1dd9866e13b03277259d: 2023-07-15 19:06:46,365 DEBUG [rs(jenkins-hbase4.apache.org,36223,1689447992001)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:46,365 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 19:06:46,365 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 19:06:46,365 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,365 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionTimestamps' locally acquired 2023-07-15 19:06:46,365 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure (testCompactionTimestamps) in zk 2023-07-15 19:06:46,366 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,366 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:46,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:46,367 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,367 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionTimestamps' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:46,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:46,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:46,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:46,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure 'testCompactionTimestamps' on coordinator 2023-07-15 19:06:46,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c3cf0d6[Count = 0] remaining members to acquire global barrier 2023-07-15 19:06:46,369 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionTimestamps' starting 'in-barrier' execution. 2023-07-15 19:06:46,369 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,370 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,370 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,370 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,371 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,371 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 19:06:46,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionTimestamps' received 'reached' from coordinator. 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,42217,1689447992037' in zk 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionTimestamps' locally completed 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,42361,1689447991925' in zk 2023-07-15 19:06:46,371 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionTimestamps' completed for member 'jenkins-hbase4.apache.org,36223,1689447992001' in zk 2023-07-15 19:06:46,373 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:46,373 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:46,373 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,373 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:46,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:46,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:46,375 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:46,375 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:46,375 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionTimestamps' has notified controller of completion 2023-07-15 19:06:46,375 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:46,375 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:46,378 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionTimestamps' completed. 2023-07-15 19:06:46,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:46,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:46,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:46,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionTimestamps' member 'jenkins-hbase4.apache.org,36223,1689447992001': 2023-07-15 19:06:46,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' released barrier for procedure'testCompactionTimestamps', counting down latch. Waiting for 0 more 2023-07-15 19:06:46,381 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionTimestamps' execution completed 2023-07-15 19:06:46,381 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 19:06:46,382 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 19:06:46,382 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionTimestamps 2023-07-15 19:06:46,382 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionTimestampsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 19:06:46,383 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,383 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,383 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,383 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,383 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:46,384 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,384 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,383 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,384 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,385 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:46,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,387 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,387 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:46,388 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionTimestamps 2023-07-15 19:06:46,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,391 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,391 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,391 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,391 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,391 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:46,391 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionTimestamps because node does not exist (not an error) 2023-07-15 19:06:46,391 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionTimestamps 2023-07-15 19:06:46,392 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:46,392 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionTimestamps' 2023-07-15 19:06:46,392 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 19:06:46,391 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:46,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:46,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionTimestamps'' to complete. (max 50000 ms per retry) 2023-07-15 19:06:46,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 19:06:46,392 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionTimestamps 2023-07-15 19:06:46,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:46,393 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionTimestamps 2023-07-15 19:06:46,643 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 19:06:46,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-15 19:06:46,646 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testCompactionTimestamps 2023-07-15 19:06:46,646 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionTimestamps 2023-07-15 19:06:46,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionTimestamps 2023-07-15 19:06:46,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-15 19:06:46,650 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionTimestamps","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448006650"}]},"ts":"1689448006650"} 2023-07-15 19:06:46,652 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionTimestamps, state=DISABLING in hbase:meta 2023-07-15 19:06:46,653 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionTimestamps to state=DISABLING 2023-07-15 19:06:46,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionTimestamps, region=6a99215c817b1dd9866e13b03277259d, UNASSIGN}] 2023-07-15 19:06:46,656 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionTimestamps, region=6a99215c817b1dd9866e13b03277259d, UNASSIGN 2023-07-15 19:06:46,657 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6a99215c817b1dd9866e13b03277259d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:46,657 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689448006656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448006656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448006656"}]},"ts":"1689448006656"} 2023-07-15 19:06:46,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 6a99215c817b1dd9866e13b03277259d, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:46,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:46,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6a99215c817b1dd9866e13b03277259d, disabling compactions & flushes 2023-07-15 19:06:46,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:46,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:46,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. after waiting 0 ms 2023-07-15 19:06:46,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:46,816 DEBUG [StoreCloser-testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/4be02dbb1eef4035aaa358ed886b9adf, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/8ee632ad6c924551bc5c316c42df4798] to archive 2023-07-15 19:06:46,817 DEBUG [StoreCloser-testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:46,819 DEBUG [StoreCloser-testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/4be02dbb1eef4035aaa358ed886b9adf to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/4be02dbb1eef4035aaa358ed886b9adf 2023-07-15 19:06:46,821 DEBUG [StoreCloser-testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/8ee632ad6c924551bc5c316c42df4798 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/8ee632ad6c924551bc5c316c42df4798 2023-07-15 19:06:46,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 19:06:46,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d. 2023-07-15 19:06:46,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6a99215c817b1dd9866e13b03277259d: 2023-07-15 19:06:46,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:46,838 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6a99215c817b1dd9866e13b03277259d, regionState=CLOSED 2023-07-15 19:06:46,838 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689448006838"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448006838"}]},"ts":"1689448006838"} 2023-07-15 19:06:46,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 19:06:46,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 6a99215c817b1dd9866e13b03277259d, server=jenkins-hbase4.apache.org,36223,1689447992001 in 182 msec 2023-07-15 19:06:46,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-07-15 19:06:46,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testCompactionTimestamps, region=6a99215c817b1dd9866e13b03277259d, UNASSIGN in 188 msec 2023-07-15 19:06:46,844 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionTimestamps","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448006844"}]},"ts":"1689448006844"} 2023-07-15 19:06:46,845 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionTimestamps, state=DISABLED in hbase:meta 2023-07-15 19:06:46,851 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionTimestamps to state=DISABLED 2023-07-15 19:06:46,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testCompactionTimestamps in 206 msec 2023-07-15 19:06:46,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-15 19:06:46,902 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionTimestamps, procId: 75 completed 2023-07-15 19:06:46,902 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testCompactionTimestamps 2023-07-15 19:06:46,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testCompactionTimestamps 2023-07-15 19:06:46,905 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testCompactionTimestamps 2023-07-15 19:06:46,906 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testCompactionTimestamps 2023-07-15 19:06:46,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-15 19:06:46,910 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:46,911 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/recovered.edits] 2023-07-15 19:06:46,914 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/0eea39b621974925a4e10739f934a131 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/0eea39b621974925a4e10739f934a131 2023-07-15 19:06:46,916 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/32cc4f91fa294583a8327f0b9874c94b to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/32cc4f91fa294583a8327f0b9874c94b 2023-07-15 19:06:46,918 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/ff17b0255c7c4c1aab6a43fe849b804b to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/fam1/ff17b0255c7c4c1aab6a43fe849b804b 2023-07-15 19:06:46,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/recovered.edits/21.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d/recovered.edits/21.seqid 2023-07-15 19:06:46,922 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactionTimestamps/6a99215c817b1dd9866e13b03277259d 2023-07-15 19:06:46,922 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionTimestamps regions 2023-07-15 19:06:46,937 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testCompactionTimestamps 2023-07-15 19:06:46,939 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testCompactionTimestamps from hbase:meta 2023-07-15 19:06:46,940 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testCompactionTimestamps' descriptor. 2023-07-15 19:06:46,942 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testCompactionTimestamps 2023-07-15 19:06:46,942 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testCompactionTimestamps' from region states. 2023-07-15 19:06:46,942 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448006942"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:46,946 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 19:06:46,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6a99215c817b1dd9866e13b03277259d, NAME => 'testCompactionTimestamps,,1689448004487.6a99215c817b1dd9866e13b03277259d.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 19:06:46,946 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testCompactionTimestamps' as deleted. 2023-07-15 19:06:46,947 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionTimestamps","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448006946"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:46,948 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testCompactionTimestamps state from META 2023-07-15 19:06:46,950 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testCompactionTimestamps 2023-07-15 19:06:46,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testCompactionTimestamps in 47 msec 2023-07-15 19:06:47,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-15 19:06:47,158 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testCompactionTimestamps, procId: 78 completed 2023-07-15 19:06:47,175 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testCompactionTimestamps Thread=614 (was 617), OpenFileDescriptor=738 (was 752), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 263), ProcessCount=170 (was 170), AvailableMemoryMB=5345 (was 5341) - AvailableMemoryMB LEAK? - 2023-07-15 19:06:47,175 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=614 is superior to 500 2023-07-15 19:06:47,192 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testSplitShouldNotHappenIfSplitIsDisabledForTable Thread=614, OpenFileDescriptor=738, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=170, AvailableMemoryMB=5344 2023-07-15 19:06:47,192 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=614 is superior to 500 2023-07-15 19:06:47,194 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testSplitShouldNotHappenIfSplitIsDisabledForTable', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:47,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:47,198 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testSplitShouldNotHappenIfSplitIsDisabledForTable" procId is: 79 2023-07-15 19:06:47,198 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:47,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-15 19:06:47,200 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,200 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f empty. 2023-07-15 19:06:47,201 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,201 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testSplitShouldNotHappenIfSplitIsDisabledForTable regions 2023-07-15 19:06:47,225 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:47,227 INFO [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0ebd7ed8880d0fa1e013361dfd98191f, NAME => 'testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testSplitShouldNotHappenIfSplitIsDisabledForTable', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:47,255 DEBUG [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(866): Instantiated testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:47,255 DEBUG [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(1604): Closing 0ebd7ed8880d0fa1e013361dfd98191f, disabling compactions & flushes 2023-07-15 19:06:47,255 INFO [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(1626): Closing region testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:47,256 DEBUG [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:47,256 DEBUG [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(1714): Acquired close lock on testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. after waiting 0 ms 2023-07-15 19:06:47,256 DEBUG [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(1724): Updates disabled for region testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:47,256 INFO [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(1838): Closed testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:47,256 DEBUG [RegionOpenAndInit-testSplitShouldNotHappenIfSplitIsDisabledForTable-pool-0] regionserver.HRegion(1558): Region close journal for 0ebd7ed8880d0fa1e013361dfd98191f: 2023-07-15 19:06:47,259 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:47,260 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689448007260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448007260"}]},"ts":"1689448007260"} 2023-07-15 19:06:47,262 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:47,263 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:47,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448007263"}]},"ts":"1689448007263"} 2023-07-15 19:06:47,265 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitShouldNotHappenIfSplitIsDisabledForTable, state=ENABLING in hbase:meta 2023-07-15 19:06:47,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:47,270 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:47,270 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:47,270 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:47,270 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:47,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable, region=0ebd7ed8880d0fa1e013361dfd98191f, ASSIGN}] 2023-07-15 19:06:47,273 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable, region=0ebd7ed8880d0fa1e013361dfd98191f, ASSIGN 2023-07-15 19:06:47,278 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable, region=0ebd7ed8880d0fa1e013361dfd98191f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:47,428 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:47,430 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0ebd7ed8880d0fa1e013361dfd98191f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:47,430 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689448007429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448007429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448007429"}]},"ts":"1689448007429"} 2023-07-15 19:06:47,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE; OpenRegionProcedure 0ebd7ed8880d0fa1e013361dfd98191f, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:47,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-15 19:06:47,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:47,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ebd7ed8880d0fa1e013361dfd98191f, NAME => 'testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:47,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitShouldNotHappenIfSplitIsDisabledForTable 0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:47,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,592 INFO [StoreOpener-0ebd7ed8880d0fa1e013361dfd98191f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,593 DEBUG [StoreOpener-0ebd7ed8880d0fa1e013361dfd98191f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/f 2023-07-15 19:06:47,593 DEBUG [StoreOpener-0ebd7ed8880d0fa1e013361dfd98191f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/f 2023-07-15 19:06:47,594 INFO [StoreOpener-0ebd7ed8880d0fa1e013361dfd98191f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ebd7ed8880d0fa1e013361dfd98191f columnFamilyName f 2023-07-15 19:06:47,594 INFO [StoreOpener-0ebd7ed8880d0fa1e013361dfd98191f-1] regionserver.HStore(310): Store=0ebd7ed8880d0fa1e013361dfd98191f/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:47,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:47,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:47,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ebd7ed8880d0fa1e013361dfd98191f; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@51c24f44, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:47,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ebd7ed8880d0fa1e013361dfd98191f: 2023-07-15 19:06:47,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f., pid=81, masterSystemTime=1689448007583 2023-07-15 19:06:47,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:47,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:47,608 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0ebd7ed8880d0fa1e013361dfd98191f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:47,608 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689448007607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448007607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448007607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448007607"}]},"ts":"1689448007607"} 2023-07-15 19:06:47,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 19:06:47,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; OpenRegionProcedure 0ebd7ed8880d0fa1e013361dfd98191f, server=jenkins-hbase4.apache.org,42217,1689447992037 in 178 msec 2023-07-15 19:06:47,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-07-15 19:06:47,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable, region=0ebd7ed8880d0fa1e013361dfd98191f, ASSIGN in 341 msec 2023-07-15 19:06:47,614 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:47,614 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448007614"}]},"ts":"1689448007614"} 2023-07-15 19:06:47,615 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testSplitShouldNotHappenIfSplitIsDisabledForTable, state=ENABLED in hbase:meta 2023-07-15 19:06:47,622 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:47,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable in 428 msec 2023-07-15 19:06:47,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-15 19:06:47,951 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testSplitShouldNotHappenIfSplitIsDisabledForTable, procId: 79 completed 2023-07-15 19:06:47,951 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testSplitShouldNotHappenIfSplitIsDisabledForTable get assigned. Timeout = 60000ms 2023-07-15 19:06:47,952 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:47,954 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testSplitShouldNotHappenIfSplitIsDisabledForTable assigned to meta. Checking AM states. 2023-07-15 19:06:47,954 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:47,955 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testSplitShouldNotHappenIfSplitIsDisabledForTable assigned. 2023-07-15 19:06:47,969 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 19:06:47,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,970 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' 2023-07-15 19:06:47,970 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:47,972 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' starting 'acquire' 2023-07-15 19:06:47,972 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable', kicking off acquire phase on members. 2023-07-15 19:06:47,972 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,972 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,973 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:47,973 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:47,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:47,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:47,973 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:47,973 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:47,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,974 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:47,974 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 19:06:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,975 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' with timeout 60000ms 2023-07-15 19:06:47,975 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:47,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,976 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' with timeout 60000ms 2023-07-15 19:06:47,976 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:47,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' starting 'acquire' stage 2023-07-15 19:06:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' with timeout 60000ms 2023-07-15 19:06:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' locally acquired 2023-07-15 19:06:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:06:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' starting 'acquire' stage 2023-07-15 19:06:47,980 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' starting 'acquire' stage 2023-07-15 19:06:47,980 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' locally acquired 2023-07-15 19:06:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42361,1689447991925' joining acquired barrier for procedure (testSplitShouldNotHappenIfSplitIsDisabledForTable) in zk 2023-07-15 19:06:47,980 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 19:06:47,980 DEBUG [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:47,980 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 19:06:47,980 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure (testSplitShouldNotHappenIfSplitIsDisabledForTable) in zk 2023-07-15 19:06:47,980 DEBUG [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. started... 2023-07-15 19:06:47,981 INFO [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0ebd7ed8880d0fa1e013361dfd98191f 1/1 column families, dataSize=290 B heapSize=1.27 KB 2023-07-15 19:06:47,982 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,986 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,986 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,986 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:47,986 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:47,986 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:47,998 INFO [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=290 B at sequenceid=14 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/.tmp/f/054052b05fd34d60a1ee9f8743206a7a 2023-07-15 19:06:48,006 DEBUG [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/.tmp/f/054052b05fd34d60a1ee9f8743206a7a as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/f/054052b05fd34d60a1ee9f8743206a7a 2023-07-15 19:06:48,011 INFO [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/f/054052b05fd34d60a1ee9f8743206a7a, entries=10, sequenceid=14, filesize=5.0 K 2023-07-15 19:06:48,012 INFO [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~290 B/290, heapSize ~1.25 KB/1280, currentSize=0 B/0 for 0ebd7ed8880d0fa1e013361dfd98191f in 31ms, sequenceid=14, compaction requested=false 2023-07-15 19:06:48,012 DEBUG [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testSplitShouldNotHappenIfSplitIsDisabledForTable' 2023-07-15 19:06:48,012 DEBUG [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0ebd7ed8880d0fa1e013361dfd98191f: 2023-07-15 19:06:48,012 DEBUG [rs(jenkins-hbase4.apache.org,42217,1689447992037)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:48,012 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 19:06:48,013 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 19:06:48,013 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,013 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' locally acquired 2023-07-15 19:06:48,013 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42217,1689447992037' joining acquired barrier for procedure (testSplitShouldNotHappenIfSplitIsDisabledForTable) in zk 2023-07-15 19:06:48,015 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,015 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:48,016 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,016 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:06:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:48,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42217,1689447992037' joining acquired barrier for procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' on coordinator 2023-07-15 19:06:48,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@96a5f28[Count = 0] remaining members to acquire global barrier 2023-07-15 19:06:48,018 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' starting 'in-barrier' execution. 2023-07-15 19:06:48,018 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' received 'reached' from coordinator. 2023-07-15 19:06:48,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,020 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 19:06:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' received 'reached' from coordinator. 2023-07-15 19:06:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' received 'reached' from coordinator. 2023-07-15 19:06:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' locally completed 2023-07-15 19:06:48,019 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' locally completed 2023-07-15 19:06:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' completed for member 'jenkins-hbase4.apache.org,42361,1689447991925' in zk 2023-07-15 19:06:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' locally completed 2023-07-15 19:06:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' completed for member 'jenkins-hbase4.apache.org,42217,1689447992037' in zk 2023-07-15 19:06:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' completed for member 'jenkins-hbase4.apache.org,36223,1689447992001' in zk 2023-07-15 19:06:48,021 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' has notified controller of completion 2023-07-15 19:06:48,021 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' has notified controller of completion 2023-07-15 19:06:48,021 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:48,021 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,021 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' completed. 2023-07-15 19:06:48,021 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:48,022 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' has notified controller of completion 2023-07-15 19:06:48,023 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:48,022 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' completed. 2023-07-15 19:06:48,023 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' completed. 2023-07-15 19:06:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:48,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' member 'jenkins-hbase4.apache.org,42217,1689447992037': 2023-07-15 19:06:48,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42217,1689447992037' released barrier for procedure'testSplitShouldNotHappenIfSplitIsDisabledForTable', counting down latch. Waiting for 0 more 2023-07-15 19:06:48,027 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotHappenIfSplitIsDisabledForTable' execution completed 2023-07-15 19:06:48,027 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 19:06:48,027 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 19:06:48,027 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,027 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotHappenIfSplitIsDisabledForTableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 19:06:48,029 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,029 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,029 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:48,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,029 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:48,029 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,029 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:06:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:06:48,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:48,030 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:48,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,030 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:06:48,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,035 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:48,035 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:06:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:06:48,037 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,037 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,038 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,040 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,040 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:48,040 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:48,040 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:48,041 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:48,041 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotHappenIfSplitIsDisabledForTable' 2023-07-15 19:06:48,041 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 19:06:48,041 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,041 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:06:48,041 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:48,041 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:06:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:06:48,041 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotHappenIfSplitIsDisabledForTable'' to complete. (max 50000 ms per retry) 2023-07-15 19:06:48,042 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 19:06:48,041 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:06:48,041 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,041 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:06:48,042 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,042 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:48,043 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:48,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:06:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:06:48,043 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:48,043 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,043 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,292 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 19:06:48,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-15 19:06:48,298 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:48,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(219): Splittable=false state=OPEN, location=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.DoNotRetryIOException: 0ebd7ed8880d0fa1e013361dfd98191f NOT splittable at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:228) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:06:48,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 277 service: MasterService methodName: SplitRegion size: 133 connection: 172.31.14.131:58506 deadline: 1689448068298, exception=org.apache.hadoop.hbase.DoNotRetryIOException: 0ebd7ed8880d0fa1e013361dfd98191f NOT splittable 2023-07-15 19:06:48,302 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,303 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 19:06:48,307 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448008307"}]},"ts":"1689448008307"} 2023-07-15 19:06:48,308 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testSplitShouldNotHappenIfSplitIsDisabledForTable, state=DISABLING in hbase:meta 2023-07-15 19:06:48,309 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testSplitShouldNotHappenIfSplitIsDisabledForTable to state=DISABLING 2023-07-15 19:06:48,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=83, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable, region=0ebd7ed8880d0fa1e013361dfd98191f, UNASSIGN}] 2023-07-15 19:06:48,311 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=84, ppid=83, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable, region=0ebd7ed8880d0fa1e013361dfd98191f, UNASSIGN 2023-07-15 19:06:48,312 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=84 updating hbase:meta row=0ebd7ed8880d0fa1e013361dfd98191f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:48,312 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689448008312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448008312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448008312"}]},"ts":"1689448008312"} 2023-07-15 19:06:48,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE; CloseRegionProcedure 0ebd7ed8880d0fa1e013361dfd98191f, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:48,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:48,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ebd7ed8880d0fa1e013361dfd98191f, disabling compactions & flushes 2023-07-15 19:06:48,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:48,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:48,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. after waiting 0 ms 2023-07-15 19:06:48,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:48,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2023-07-15 19:06:48,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f. 2023-07-15 19:06:48,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ebd7ed8880d0fa1e013361dfd98191f: 2023-07-15 19:06:48,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:48,474 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=84 updating hbase:meta row=0ebd7ed8880d0fa1e013361dfd98191f, regionState=CLOSED 2023-07-15 19:06:48,474 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689448008474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448008474"}]},"ts":"1689448008474"} 2023-07-15 19:06:48,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-15 19:06:48,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; CloseRegionProcedure 0ebd7ed8880d0fa1e013361dfd98191f, server=jenkins-hbase4.apache.org,42217,1689447992037 in 162 msec 2023-07-15 19:06:48,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=83 2023-07-15 19:06:48,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=83, state=SUCCESS; TransitRegionStateProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable, region=0ebd7ed8880d0fa1e013361dfd98191f, UNASSIGN in 166 msec 2023-07-15 19:06:48,478 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448008478"}]},"ts":"1689448008478"} 2023-07-15 19:06:48,479 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testSplitShouldNotHappenIfSplitIsDisabledForTable, state=DISABLED in hbase:meta 2023-07-15 19:06:48,482 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testSplitShouldNotHappenIfSplitIsDisabledForTable to state=DISABLED 2023-07-15 19:06:48,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DisableTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable in 180 msec 2023-07-15 19:06:48,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 19:06:48,558 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testSplitShouldNotHappenIfSplitIsDisabledForTable, procId: 83 completed 2023-07-15 19:06:48,559 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,561 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=86, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,562 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=86, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=86 2023-07-15 19:06:48,565 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:48,567 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/f, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/recovered.edits] 2023-07-15 19:06:48,570 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/f/054052b05fd34d60a1ee9f8743206a7a to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/f/054052b05fd34d60a1ee9f8743206a7a 2023-07-15 19:06:48,573 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/recovered.edits/17.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f/recovered.edits/17.seqid 2023-07-15 19:06:48,573 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitShouldNotHappenIfSplitIsDisabledForTable/0ebd7ed8880d0fa1e013361dfd98191f 2023-07-15 19:06:48,574 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testSplitShouldNotHappenIfSplitIsDisabledForTable regions 2023-07-15 19:06:48,576 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=86, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,577 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testSplitShouldNotHappenIfSplitIsDisabledForTable from hbase:meta 2023-07-15 19:06:48,578 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testSplitShouldNotHappenIfSplitIsDisabledForTable' descriptor. 2023-07-15 19:06:48,579 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=86, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,579 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testSplitShouldNotHappenIfSplitIsDisabledForTable' from region states. 2023-07-15 19:06:48,580 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448008579"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:48,581 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 19:06:48,581 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0ebd7ed8880d0fa1e013361dfd98191f, NAME => 'testSplitShouldNotHappenIfSplitIsDisabledForTable,,1689448007194.0ebd7ed8880d0fa1e013361dfd98191f.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 19:06:48,581 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testSplitShouldNotHappenIfSplitIsDisabledForTable' as deleted. 2023-07-15 19:06:48,581 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitShouldNotHappenIfSplitIsDisabledForTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448008581"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:48,582 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testSplitShouldNotHappenIfSplitIsDisabledForTable state from META 2023-07-15 19:06:48,584 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=86, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable 2023-07-15 19:06:48,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; DeleteTableProcedure table=testSplitShouldNotHappenIfSplitIsDisabledForTable in 25 msec 2023-07-15 19:06:48,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=86 2023-07-15 19:06:48,813 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testSplitShouldNotHappenIfSplitIsDisabledForTable, procId: 86 completed 2023-07-15 19:06:48,832 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testSplitShouldNotHappenIfSplitIsDisabledForTable Thread=620 (was 614) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_185109502_17 at /127.0.0.1:38400 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_185109502_17 at /127.0.0.1:40154 [Waiting for operation #23] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1510362327_17 at /127.0.0.1:33602 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1510362327_17 at /127.0.0.1:42084 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-metaLookup-shared--pool-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-metaLookup-shared--pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_185109502_17 at /127.0.0.1:38446 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=740 (was 738) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 263), ProcessCount=170 (was 170), AvailableMemoryMB=5342 (was 5344) 2023-07-15 19:06:48,832 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=620 is superior to 500 2023-07-15 19:06:48,851 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testForceSplitMultiFamily Thread=620, OpenFileDescriptor=740, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=170, AvailableMemoryMB=5342 2023-07-15 19:06:48,851 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=620 is superior to 500 2023-07-15 19:06:48,854 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf1 must be between 1K and 16MB. 2023-07-15 19:06:48,854 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf2 must be between 1K and 16MB. 2023-07-15 19:06:48,855 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testForceSplit', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, {NAME => 'cf2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:48,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testForceSplit 2023-07-15 19:06:48,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=87, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:48,857 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testForceSplit" procId is: 87 2023-07-15 19:06:48,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=87, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:48,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=87 2023-07-15 19:06:48,859 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:48,860 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777 empty. 2023-07-15 19:06:48,860 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:48,860 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:48,872 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:48,873 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => b2eae93e6083c934caa7e6f760243777, NAME => 'testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testForceSplit', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, {NAME => 'cf2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:48,881 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:48,881 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1604): Closing b2eae93e6083c934caa7e6f760243777, disabling compactions & flushes 2023-07-15 19:06:48,881 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:48,881 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:48,881 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. after waiting 0 ms 2023-07-15 19:06:48,881 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:48,881 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:48,881 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1558): Region close journal for b2eae93e6083c934caa7e6f760243777: 2023-07-15 19:06:48,883 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=87, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:48,884 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448008884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448008884"}]},"ts":"1689448008884"} 2023-07-15 19:06:48,886 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:48,886 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=87, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:48,887 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448008886"}]},"ts":"1689448008886"} 2023-07-15 19:06:48,888 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLING in hbase:meta 2023-07-15 19:06:48,894 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:48,895 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:48,895 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:48,895 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:48,895 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:48,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=87, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=b2eae93e6083c934caa7e6f760243777, ASSIGN}] 2023-07-15 19:06:48,899 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=88, ppid=87, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=b2eae93e6083c934caa7e6f760243777, ASSIGN 2023-07-15 19:06:48,900 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=88, ppid=87, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=b2eae93e6083c934caa7e6f760243777, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:49,050 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:49,052 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=88 updating hbase:meta row=b2eae93e6083c934caa7e6f760243777, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:49,052 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448009052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448009052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448009052"}]},"ts":"1689448009052"} 2023-07-15 19:06:49,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE; OpenRegionProcedure b2eae93e6083c934caa7e6f760243777, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:49,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=87 2023-07-15 19:06:49,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b2eae93e6083c934caa7e6f760243777, NAME => 'testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:49,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:49,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,210 INFO [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,212 DEBUG [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1 2023-07-15 19:06:49,212 DEBUG [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1 2023-07-15 19:06:49,212 INFO [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2eae93e6083c934caa7e6f760243777 columnFamilyName cf1 2023-07-15 19:06:49,213 INFO [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] regionserver.HStore(310): Store=b2eae93e6083c934caa7e6f760243777/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:49,213 INFO [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,214 DEBUG [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2 2023-07-15 19:06:49,214 DEBUG [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2 2023-07-15 19:06:49,215 INFO [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2eae93e6083c934caa7e6f760243777 columnFamilyName cf2 2023-07-15 19:06:49,215 INFO [StoreOpener-b2eae93e6083c934caa7e6f760243777-1] regionserver.HStore(310): Store=b2eae93e6083c934caa7e6f760243777/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:49,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:49,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:49,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b2eae93e6083c934caa7e6f760243777; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74451604, jitterRate=0.10941535234451294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:49,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b2eae93e6083c934caa7e6f760243777: 2023-07-15 19:06:49,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777., pid=89, masterSystemTime=1689448009205 2023-07-15 19:06:49,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,224 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=88 updating hbase:meta row=b2eae93e6083c934caa7e6f760243777, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:49,224 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448009224"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448009224"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448009224"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448009224"}]},"ts":"1689448009224"} 2023-07-15 19:06:49,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-07-15 19:06:49,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; OpenRegionProcedure b2eae93e6083c934caa7e6f760243777, server=jenkins-hbase4.apache.org,42217,1689447992037 in 172 msec 2023-07-15 19:06:49,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=87 2023-07-15 19:06:49,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=87, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=b2eae93e6083c934caa7e6f760243777, ASSIGN in 331 msec 2023-07-15 19:06:49,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=87, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:49,228 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448009228"}]},"ts":"1689448009228"} 2023-07-15 19:06:49,230 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLED in hbase:meta 2023-07-15 19:06:49,232 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=87, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:49,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; CreateTableProcedure table=testForceSplit in 377 msec 2023-07-15 19:06:49,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=87 2023-07-15 19:06:49,611 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testForceSplit, procId: 87 completed 2023-07-15 19:06:49,611 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testForceSplit get assigned. Timeout = 60000ms 2023-07-15 19:06:49,611 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:49,614 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testForceSplit assigned to meta. Checking AM states. 2023-07-15 19:06:49,614 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:49,614 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testForceSplit assigned. 2023-07-15 19:06:49,628 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 19:06:49,638 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6000 Client: jenkins//172.31.14.131 first region in multi=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,686 INFO [Listener at localhost/45529] client.TestAdmin1(291): Initial regions (1): [region=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777., hostname=jenkins-hbase4.apache.org,42217,1689447992037, seqNum=2] 2023-07-15 19:06:49,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:49,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:49,707 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,707 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(206): testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:49,709 INFO [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.HRegion(2745): Flushing b2eae93e6083c934caa7e6f760243777 2/2 column families, dataSize=181.67 KB heapSize=609.98 KB 2023-07-15 19:06:49,728 INFO [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=181.64 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/.tmp/cf1/c952d35079ba4db596cd2d12fd6c03a9 2023-07-15 19:06:49,746 INFO [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/.tmp/cf2/257c91335cf74d498f9bd9bdd0716091 2023-07-15 19:06:49,753 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/.tmp/cf1/c952d35079ba4db596cd2d12fd6c03a9 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9 2023-07-15 19:06:49,759 INFO [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9, entries=6000, sequenceid=6, filesize=248.5 K 2023-07-15 19:06:49,761 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/.tmp/cf2/257c91335cf74d498f9bd9bdd0716091 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2/257c91335cf74d498f9bd9bdd0716091 2023-07-15 19:06:49,766 INFO [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2/257c91335cf74d498f9bd9bdd0716091, entries=1, sequenceid=6, filesize=4.8 K 2023-07-15 19:06:49,767 INFO [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.HRegion(2948): Finished flush of dataSize ~181.67 KB/186031, heapSize ~609.95 KB/624584, currentSize=0 B/0 for b2eae93e6083c934caa7e6f760243777 in 58ms, sequenceid=6, compaction requested=false 2023-07-15 19:06:49,768 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.HRegion(2446): Flush status journal for b2eae93e6083c934caa7e6f760243777: 2023-07-15 19:06:49,768 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=11,queue=1,port=42217] regionserver.StoreUtils(129): cannot split hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2/257c91335cf74d498f9bd9bdd0716091 because midkey is the same as first or last row 2023-07-15 19:06:49,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:49,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=b2eae93e6083c934caa7e6f760243777, daughterA=a256cd27848bad25e1acd7a794db57d8, daughterB=fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:49,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=b2eae93e6083c934caa7e6f760243777, daughterA=a256cd27848bad25e1acd7a794db57d8, daughterB=fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:49,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=b2eae93e6083c934caa7e6f760243777, daughterA=a256cd27848bad25e1acd7a794db57d8, daughterB=fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:49,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=b2eae93e6083c934caa7e6f760243777, daughterA=a256cd27848bad25e1acd7a794db57d8, daughterB=fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:49,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=b2eae93e6083c934caa7e6f760243777, UNASSIGN}] 2023-07-15 19:06:49,774 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=b2eae93e6083c934caa7e6f760243777, UNASSIGN 2023-07-15 19:06:49,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b2eae93e6083c934caa7e6f760243777, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:49,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448009775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448009775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448009775"}]},"ts":"1689448009775"} 2023-07-15 19:06:49,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure b2eae93e6083c934caa7e6f760243777, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:49,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b2eae93e6083c934caa7e6f760243777, disabling compactions & flushes 2023-07-15 19:06:49,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. after waiting 0 ms 2023-07-15 19:06:49,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 19:06:49,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:49,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b2eae93e6083c934caa7e6f760243777: 2023-07-15 19:06:49,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,940 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b2eae93e6083c934caa7e6f760243777, regionState=CLOSED 2023-07-15 19:06:49,941 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448009940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448009940"}]},"ts":"1689448009940"} 2023-07-15 19:06:49,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-07-15 19:06:49,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure b2eae93e6083c934caa7e6f760243777, server=jenkins-hbase4.apache.org,42217,1689447992037 in 165 msec 2023-07-15 19:06:49,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-15 19:06:49,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=b2eae93e6083c934caa7e6f760243777, UNASSIGN in 171 msec 2023-07-15 19:06:49,953 INFO [PEWorker-2] assignment.SplitTableRegionProcedure(694): pid=90 splitting 2 storefiles, region=b2eae93e6083c934caa7e6f760243777, threads=2 2023-07-15 19:06:49,953 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=90 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2/257c91335cf74d498f9bd9bdd0716091 for region: b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,953 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=90 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9 for region: b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,958 DEBUG [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(713): Will create HFileLink file for hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2/257c91335cf74d498f9bd9bdd0716091, top=false 2023-07-15 19:06:49,964 INFO [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/.splits/a256cd27848bad25e1acd7a794db57d8/cf2/testForceSplit=b2eae93e6083c934caa7e6f760243777-257c91335cf74d498f9bd9bdd0716091 for child: a256cd27848bad25e1acd7a794db57d8, parent: b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,968 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=90 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2/257c91335cf74d498f9bd9bdd0716091 for region: b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,983 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=90 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9 for region: b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:49,984 DEBUG [PEWorker-2] assignment.SplitTableRegionProcedure(755): pid=90 split storefiles for region b2eae93e6083c934caa7e6f760243777 Daughter A: 2 storefiles, Daughter B: 1 storefiles. 2023-07-15 19:06:50,008 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=-1 2023-07-15 19:06:50,010 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=-1 2023-07-15 19:06:50,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448010011"},{"qualifier":"splitA","vlen":52,"tag":[],"timestamp":"1689448010011"},{"qualifier":"splitB","vlen":52,"tag":[],"timestamp":"1689448010011"}]},"ts":"1689448010011"} 2023-07-15 19:06:50,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448010011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448010011"}]},"ts":"1689448010011"} 2023-07-15 19:06:50,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448010011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448010011"}]},"ts":"1689448010011"} 2023-07-15 19:06:50,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=a256cd27848bad25e1acd7a794db57d8, ASSIGN}, {pid=94, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=fd8398c352b1c26dadf430aa2af7bc36, ASSIGN}] 2023-07-15 19:06:50,016 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=94, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=fd8398c352b1c26dadf430aa2af7bc36, ASSIGN 2023-07-15 19:06:50,016 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=93, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=a256cd27848bad25e1acd7a794db57d8, ASSIGN 2023-07-15 19:06:50,016 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=94, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=fd8398c352b1c26dadf430aa2af7bc36, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:50,016 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=93, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=a256cd27848bad25e1acd7a794db57d8, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:50,167 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 19:06:50,169 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=94 updating hbase:meta row=fd8398c352b1c26dadf430aa2af7bc36, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:50,170 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=93 updating hbase:meta row=a256cd27848bad25e1acd7a794db57d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:50,170 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448010169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448010169"}]},"ts":"1689448010169"} 2023-07-15 19:06:50,170 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448010169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448010169"}]},"ts":"1689448010169"} 2023-07-15 19:06:50,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=95, ppid=93, state=RUNNABLE; OpenRegionProcedure a256cd27848bad25e1acd7a794db57d8, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:50,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=96, ppid=94, state=RUNNABLE; OpenRegionProcedure fd8398c352b1c26dadf430aa2af7bc36, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:50,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a256cd27848bad25e1acd7a794db57d8, NAME => 'testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'} 2023-07-15 19:06:50,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:50,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,328 INFO [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,329 DEBUG [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1 2023-07-15 19:06:50,329 DEBUG [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1 2023-07-15 19:06:50,330 INFO [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a256cd27848bad25e1acd7a794db57d8 columnFamilyName cf1 2023-07-15 19:06:50,339 DEBUG [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9-bottom 2023-07-15 19:06:50,340 INFO [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] regionserver.HStore(310): Store=a256cd27848bad25e1acd7a794db57d8/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:50,340 INFO [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,341 DEBUG [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf2 2023-07-15 19:06:50,341 DEBUG [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf2 2023-07-15 19:06:50,341 INFO [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a256cd27848bad25e1acd7a794db57d8 columnFamilyName cf2 2023-07-15 19:06:50,347 DEBUG [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf2/testForceSplit=b2eae93e6083c934caa7e6f760243777-257c91335cf74d498f9bd9bdd0716091 2023-07-15 19:06:50,348 INFO [StoreOpener-a256cd27848bad25e1acd7a794db57d8-1] regionserver.HStore(310): Store=a256cd27848bad25e1acd7a794db57d8/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:50,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:50,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a256cd27848bad25e1acd7a794db57d8; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71058351, jitterRate=0.0588519424200058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:50,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a256cd27848bad25e1acd7a794db57d8: 2023-07-15 19:06:50,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8., pid=95, masterSystemTime=1689448010323 2023-07-15 19:06:50,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:50,355 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:50,356 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf1 since it belongs to recently split daughter region testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,356 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HStore(1912): a256cd27848bad25e1acd7a794db57d8/cf1 is initiating minor compaction (all files) 2023-07-15 19:06:50,356 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a256cd27848bad25e1acd7a794db57d8/cf1 in testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,356 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9-bottom] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/.tmp, totalSize=248.5 K 2023-07-15 19:06:50,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:50,356 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] compactions.Compactor(207): Compacting c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777, keycount=3000, bloomtype=ROW, size=248.5 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689448009653 2023-07-15 19:06:50,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd8398c352b1c26dadf430aa2af7bc36, NAME => 'testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.', STARTKEY => '\x00\x00\x0B\xB8', ENDKEY => ''} 2023-07-15 19:06:50,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=93 updating hbase:meta row=a256cd27848bad25e1acd7a794db57d8, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:50,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:50,357 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010357"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448010357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448010357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448010357"}]},"ts":"1689448010357"} 2023-07-15 19:06:50,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,358 INFO [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,359 DEBUG [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1 2023-07-15 19:06:50,360 DEBUG [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1 2023-07-15 19:06:50,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=95, resume processing ppid=93 2023-07-15 19:06:50,360 INFO [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd8398c352b1c26dadf430aa2af7bc36 columnFamilyName cf1 2023-07-15 19:06:50,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, ppid=93, state=SUCCESS; OpenRegionProcedure a256cd27848bad25e1acd7a794db57d8, server=jenkins-hbase4.apache.org,42217,1689447992037 in 187 msec 2023-07-15 19:06:50,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=a256cd27848bad25e1acd7a794db57d8, ASSIGN in 345 msec 2023-07-15 19:06:50,367 DEBUG [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9-top 2023-07-15 19:06:50,367 INFO [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] regionserver.HStore(310): Store=fd8398c352b1c26dadf430aa2af7bc36/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:50,367 INFO [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,368 DEBUG [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf2 2023-07-15 19:06:50,368 DEBUG [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf2 2023-07-15 19:06:50,369 INFO [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd8398c352b1c26dadf430aa2af7bc36 columnFamilyName cf2 2023-07-15 19:06:50,369 INFO [StoreOpener-fd8398c352b1c26dadf430aa2af7bc36-1] regionserver.HStore(310): Store=fd8398c352b1c26dadf430aa2af7bc36/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:50,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:50,374 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] throttle.PressureAwareThroughputController(145): a256cd27848bad25e1acd7a794db57d8#cf1#compaction#17 average throughput is 7.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:50,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd8398c352b1c26dadf430aa2af7bc36; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59238319, jitterRate=-0.1172802597284317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:50,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd8398c352b1c26dadf430aa2af7bc36: 2023-07-15 19:06:50,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36., pid=96, masterSystemTime=1689448010323 2023-07-15 19:06:50,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-15 19:06:50,377 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:50,378 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf1 since it belongs to recently split daughter region testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:50,378 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HStore(1912): fd8398c352b1c26dadf430aa2af7bc36/cf1 is initiating minor compaction (all files) 2023-07-15 19:06:50,378 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HRegion(2259): Starting compaction of fd8398c352b1c26dadf430aa2af7bc36/cf1 in testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:50,378 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9-top] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/.tmp, totalSize=248.5 K 2023-07-15 19:06:50,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:50,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:50,379 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] compactions.Compactor(207): Compacting c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777, keycount=3000, bloomtype=ROW, size=248.5 K, encoding=NONE, compression=NONE, seqNum=7, earliestPutTs=1689448009653 2023-07-15 19:06:50,379 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=94 updating hbase:meta row=fd8398c352b1c26dadf430aa2af7bc36, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:50,380 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010379"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448010379"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448010379"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448010379"}]},"ts":"1689448010379"} 2023-07-15 19:06:50,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=96, resume processing ppid=94 2023-07-15 19:06:50,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, ppid=94, state=SUCCESS; OpenRegionProcedure fd8398c352b1c26dadf430aa2af7bc36, server=jenkins-hbase4.apache.org,42217,1689447992037 in 210 msec 2023-07-15 19:06:50,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=90 2023-07-15 19:06:50,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=fd8398c352b1c26dadf430aa2af7bc36, ASSIGN in 368 msec 2023-07-15 19:06:50,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; SplitTableRegionProcedure table=testForceSplit, parent=b2eae93e6083c934caa7e6f760243777, daughterA=a256cd27848bad25e1acd7a794db57d8, daughterB=fd8398c352b1c26dadf430aa2af7bc36 in 617 msec 2023-07-15 19:06:50,388 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/.tmp/cf1/f00c91d1f8354de7a21a038cdb136b72 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1/f00c91d1f8354de7a21a038cdb136b72 2023-07-15 19:06:50,395 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in a256cd27848bad25e1acd7a794db57d8/cf1 of a256cd27848bad25e1acd7a794db57d8 into f00c91d1f8354de7a21a038cdb136b72(size=126.6 K), total size for store is 126.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:50,395 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a256cd27848bad25e1acd7a794db57d8: 2023-07-15 19:06:50,395 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8., storeName=a256cd27848bad25e1acd7a794db57d8/cf1, priority=15, startTime=1689448010354; duration=0sec 2023-07-15 19:06:50,395 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] throttle.PressureAwareThroughputController(145): fd8398c352b1c26dadf430aa2af7bc36#cf1#compaction#18 average throughput is 8.87 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:50,396 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:50,411 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/.tmp/cf1/189a12039bce48cbb77cd2a010bd67ff as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1/189a12039bce48cbb77cd2a010bd67ff 2023-07-15 19:06:50,417 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in fd8398c352b1c26dadf430aa2af7bc36/cf1 of fd8398c352b1c26dadf430aa2af7bc36 into 189a12039bce48cbb77cd2a010bd67ff(size=126.6 K), total size for store is 126.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:50,417 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for fd8398c352b1c26dadf430aa2af7bc36: 2023-07-15 19:06:50,417 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36., storeName=fd8398c352b1c26dadf430aa2af7bc36/cf1, priority=15, startTime=1689448010376; duration=0sec 2023-07-15 19:06:50,418 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:50,775 INFO [CheckForSplit] client.TestAdmin1$1(333): Found: [region=testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8., hostname=jenkins-hbase4.apache.org,42217,1689447992037, seqNum=10, region=testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36., hostname=jenkins-hbase4.apache.org,42217,1689447992037, seqNum=10] 2023-07-15 19:06:50,775 DEBUG [CheckForSplit] client.TestAdmin1$1(338): CheckForSplit thread exited, current region count: 2 2023-07-15 19:06:50,775 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.RSRpcServices(3109): Region has changed on the scanner -1455325848360976381: regionName=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777., scannerRegionName=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777., closing... 2023-07-15 19:06:50,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] ipc.CallRunner(144): callId: 318 service: ClientService methodName: Scan size: 48 connection: 172.31.14.131:42770 deadline: 1689448070775, exception=org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -1455325848360976381: regionName=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777., scannerRegionName=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. 2023-07-15 19:06:50,777 DEBUG [Listener at localhost/45529] client.ScannerCallableWithReplicas(204): Scan with primary region returns org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:228) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:258) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:58) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:124) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:393) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:367) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -1455325848360976381: regionName=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777., scannerRegionName=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:194) ... 11 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -1455325848360976381: regionName=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777., scannerRegionName=testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-15 19:06:50,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:50,795 DEBUG [Listener at localhost/45529] client.ClientScanner(240): Advancing internal scanner to startKey at '\x00\x00\x0B\xB8', inclusive 2023-07-15 19:06:50,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:50,815 DEBUG [Listener at localhost/45529] client.TestAdmin1(373): SplitKey=3000&deltaForLargestFamily=0, r={ENCODED => a256cd27848bad25e1acd7a794db57d8, NAME => 'testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'} 2023-07-15 19:06:50,816 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testForceSplit 2023-07-15 19:06:50,816 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testForceSplit 2023-07-15 19:06:50,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testForceSplit 2023-07-15 19:06:50,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-15 19:06:50,820 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448010820"}]},"ts":"1689448010820"} 2023-07-15 19:06:50,821 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLING in hbase:meta 2023-07-15 19:06:50,823 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testForceSplit to state=DISABLING 2023-07-15 19:06:50,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=fd8398c352b1c26dadf430aa2af7bc36, UNASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=a256cd27848bad25e1acd7a794db57d8, UNASSIGN}] 2023-07-15 19:06:50,825 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=fd8398c352b1c26dadf430aa2af7bc36, UNASSIGN 2023-07-15 19:06:50,825 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=a256cd27848bad25e1acd7a794db57d8, UNASSIGN 2023-07-15 19:06:50,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=a256cd27848bad25e1acd7a794db57d8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:50,826 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=fd8398c352b1c26dadf430aa2af7bc36, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:50,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010826"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448010826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448010826"}]},"ts":"1689448010826"} 2023-07-15 19:06:50,826 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010826"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448010826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448010826"}]},"ts":"1689448010826"} 2023-07-15 19:06:50,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=98, state=RUNNABLE; CloseRegionProcedure fd8398c352b1c26dadf430aa2af7bc36, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:50,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; CloseRegionProcedure a256cd27848bad25e1acd7a794db57d8, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:50,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a256cd27848bad25e1acd7a794db57d8, disabling compactions & flushes 2023-07-15 19:06:50,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. after waiting 0 ms 2023-07-15 19:06:50,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,982 DEBUG [StoreCloser-testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9-bottom] to archive 2023-07-15 19:06:50,983 DEBUG [StoreCloser-testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:50,985 DEBUG [StoreCloser-testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:50,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=9 2023-07-15 19:06:50,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8. 2023-07-15 19:06:50,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a256cd27848bad25e1acd7a794db57d8: 2023-07-15 19:06:50,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:50,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:50,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd8398c352b1c26dadf430aa2af7bc36, disabling compactions & flushes 2023-07-15 19:06:50,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:50,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:50,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. after waiting 0 ms 2023-07-15 19:06:50,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:50,995 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=a256cd27848bad25e1acd7a794db57d8, regionState=CLOSED 2023-07-15 19:06:50,997 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448010995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448010995"}]},"ts":"1689448010995"} 2023-07-15 19:06:50,997 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9-top] to archive 2023-07-15 19:06:50,997 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:50,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-15 19:06:50,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; CloseRegionProcedure a256cd27848bad25e1acd7a794db57d8, server=jenkins-hbase4.apache.org,42217,1689447992037 in 171 msec 2023-07-15 19:06:51,000 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1/c952d35079ba4db596cd2d12fd6c03a9.b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:51,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=a256cd27848bad25e1acd7a794db57d8, UNASSIGN in 175 msec 2023-07-15 19:06:51,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=9 2023-07-15 19:06:51,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36. 2023-07-15 19:06:51,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd8398c352b1c26dadf430aa2af7bc36: 2023-07-15 19:06:51,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:51,007 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=fd8398c352b1c26dadf430aa2af7bc36, regionState=CLOSED 2023-07-15 19:06:51,007 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448011007"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448011007"}]},"ts":"1689448011007"} 2023-07-15 19:06:51,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=98 2023-07-15 19:06:51,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=98, state=SUCCESS; CloseRegionProcedure fd8398c352b1c26dadf430aa2af7bc36, server=jenkins-hbase4.apache.org,42217,1689447992037 in 181 msec 2023-07-15 19:06:51,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-07-15 19:06:51,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=fd8398c352b1c26dadf430aa2af7bc36, UNASSIGN in 185 msec 2023-07-15 19:06:51,011 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448011011"}]},"ts":"1689448011011"} 2023-07-15 19:06:51,012 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLED in hbase:meta 2023-07-15 19:06:51,014 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testForceSplit to state=DISABLED 2023-07-15 19:06:51,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; DisableTableProcedure table=testForceSplit in 198 msec 2023-07-15 19:06:51,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-15 19:06:51,071 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testForceSplit, procId: 97 completed 2023-07-15 19:06:51,072 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testForceSplit 2023-07-15 19:06:51,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=102, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:51,074 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=102, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:51,075 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=102, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:51,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=102 2023-07-15 19:06:51,080 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:51,080 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:51,080 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:51,083 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/recovered.edits] 2023-07-15 19:06:51,083 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/recovered.edits] 2023-07-15 19:06:51,083 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/recovered.edits] 2023-07-15 19:06:51,087 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1/189a12039bce48cbb77cd2a010bd67ff to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/cf1/189a12039bce48cbb77cd2a010bd67ff 2023-07-15 19:06:51,087 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1/f00c91d1f8354de7a21a038cdb136b72 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf1/f00c91d1f8354de7a21a038cdb136b72 2023-07-15 19:06:51,087 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf1/c952d35079ba4db596cd2d12fd6c03a9 2023-07-15 19:06:51,091 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2/257c91335cf74d498f9bd9bdd0716091 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/cf2/257c91335cf74d498f9bd9bdd0716091 2023-07-15 19:06:51,091 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf2/testForceSplit=b2eae93e6083c934caa7e6f760243777-257c91335cf74d498f9bd9bdd0716091 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/cf2/testForceSplit=b2eae93e6083c934caa7e6f760243777-257c91335cf74d498f9bd9bdd0716091 2023-07-15 19:06:51,092 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/recovered.edits/13.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36/recovered.edits/13.seqid 2023-07-15 19:06:51,093 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/fd8398c352b1c26dadf430aa2af7bc36 2023-07-15 19:06:51,094 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/recovered.edits/9.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777/recovered.edits/9.seqid 2023-07-15 19:06:51,095 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/recovered.edits/13.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8/recovered.edits/13.seqid 2023-07-15 19:06:51,095 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b2eae93e6083c934caa7e6f760243777 2023-07-15 19:06:51,095 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/a256cd27848bad25e1acd7a794db57d8 2023-07-15 19:06:51,095 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:51,097 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=102, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:51,100 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testForceSplit from hbase:meta 2023-07-15 19:06:51,101 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testForceSplit' descriptor. 2023-07-15 19:06:51,102 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=102, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:51,102 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testForceSplit' from region states. 2023-07-15 19:06:51,102 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448011102"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:51,102 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448011102"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:51,103 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448011102"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:51,104 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-15 19:06:51,104 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fd8398c352b1c26dadf430aa2af7bc36, NAME => 'testForceSplit,\x00\x00\x0B\xB8,1689448009768.fd8398c352b1c26dadf430aa2af7bc36.', STARTKEY => '\x00\x00\x0B\xB8', ENDKEY => ''}, {ENCODED => b2eae93e6083c934caa7e6f760243777, NAME => 'testForceSplit,,1689448008854.b2eae93e6083c934caa7e6f760243777.', STARTKEY => '', ENDKEY => ''}, {ENCODED => a256cd27848bad25e1acd7a794db57d8, NAME => 'testForceSplit,,1689448009768.a256cd27848bad25e1acd7a794db57d8.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'}] 2023-07-15 19:06:51,104 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testForceSplit' as deleted. 2023-07-15 19:06:51,104 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448011104"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:51,105 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testForceSplit state from META 2023-07-15 19:06:51,107 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=102, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:51,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, state=SUCCESS; DeleteTableProcedure table=testForceSplit in 35 msec 2023-07-15 19:06:51,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=102 2023-07-15 19:06:51,326 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testForceSplit, procId: 102 completed 2023-07-15 19:06:51,329 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf1 must be between 1K and 16MB. 2023-07-15 19:06:51,329 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf2 must be between 1K and 16MB. 2023-07-15 19:06:51,329 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testForceSplit', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, {NAME => 'cf2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:51,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=103, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testForceSplit 2023-07-15 19:06:51,332 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=103, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:51,332 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testForceSplit" procId is: 103 2023-07-15 19:06:51,332 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=103, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:51,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=103 2023-07-15 19:06:51,334 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,334 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc empty. 2023-07-15 19:06:51,335 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,335 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:51,346 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:51,347 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5aa6755930f3054da47a6f0c6b260cc, NAME => 'testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testForceSplit', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, {NAME => 'cf2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:51,363 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:51,363 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1604): Closing b5aa6755930f3054da47a6f0c6b260cc, disabling compactions & flushes 2023-07-15 19:06:51,363 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:51,363 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:51,363 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. after waiting 0 ms 2023-07-15 19:06:51,363 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:51,363 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:51,363 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1558): Region close journal for b5aa6755930f3054da47a6f0c6b260cc: 2023-07-15 19:06:51,365 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=103, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:51,366 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448011366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448011366"}]},"ts":"1689448011366"} 2023-07-15 19:06:51,367 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:51,368 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=103, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:51,368 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448011368"}]},"ts":"1689448011368"} 2023-07-15 19:06:51,369 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLING in hbase:meta 2023-07-15 19:06:51,378 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:51,379 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:51,379 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:51,379 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:51,379 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:51,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=104, ppid=103, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=b5aa6755930f3054da47a6f0c6b260cc, ASSIGN}] 2023-07-15 19:06:51,381 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=104, ppid=103, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=b5aa6755930f3054da47a6f0c6b260cc, ASSIGN 2023-07-15 19:06:51,381 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=104, ppid=103, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=b5aa6755930f3054da47a6f0c6b260cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:51,532 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:51,535 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=104 updating hbase:meta row=b5aa6755930f3054da47a6f0c6b260cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:51,535 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448011535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448011535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448011535"}]},"ts":"1689448011535"} 2023-07-15 19:06:51,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=105, ppid=104, state=RUNNABLE; OpenRegionProcedure b5aa6755930f3054da47a6f0c6b260cc, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:51,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=103 2023-07-15 19:06:51,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:51,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5aa6755930f3054da47a6f0c6b260cc, NAME => 'testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:51,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:51,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,696 INFO [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,697 DEBUG [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1 2023-07-15 19:06:51,697 DEBUG [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1 2023-07-15 19:06:51,698 INFO [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5aa6755930f3054da47a6f0c6b260cc columnFamilyName cf1 2023-07-15 19:06:51,698 INFO [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] regionserver.HStore(310): Store=b5aa6755930f3054da47a6f0c6b260cc/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:51,698 INFO [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,700 DEBUG [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2 2023-07-15 19:06:51,700 DEBUG [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2 2023-07-15 19:06:51,700 INFO [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5aa6755930f3054da47a6f0c6b260cc columnFamilyName cf2 2023-07-15 19:06:51,701 INFO [StoreOpener-b5aa6755930f3054da47a6f0c6b260cc-1] regionserver.HStore(310): Store=b5aa6755930f3054da47a6f0c6b260cc/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:51,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:51,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:51,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:51,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5aa6755930f3054da47a6f0c6b260cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75425194, jitterRate=0.12392297387123108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:51,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5aa6755930f3054da47a6f0c6b260cc: 2023-07-15 19:06:51,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc., pid=105, masterSystemTime=1689448011690 2023-07-15 19:06:51,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:51,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:51,709 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=104 updating hbase:meta row=b5aa6755930f3054da47a6f0c6b260cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:51,709 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448011709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448011709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448011709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448011709"}]},"ts":"1689448011709"} 2023-07-15 19:06:51,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=105, resume processing ppid=104 2023-07-15 19:06:51,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, ppid=104, state=SUCCESS; OpenRegionProcedure b5aa6755930f3054da47a6f0c6b260cc, server=jenkins-hbase4.apache.org,42217,1689447992037 in 174 msec 2023-07-15 19:06:51,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=104, resume processing ppid=103 2023-07-15 19:06:51,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, ppid=103, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=b5aa6755930f3054da47a6f0c6b260cc, ASSIGN in 333 msec 2023-07-15 19:06:51,714 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=103, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:51,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448011714"}]},"ts":"1689448011714"} 2023-07-15 19:06:51,716 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLED in hbase:meta 2023-07-15 19:06:51,718 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=103, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:51,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, state=SUCCESS; CreateTableProcedure table=testForceSplit in 389 msec 2023-07-15 19:06:52,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=103 2023-07-15 19:06:52,085 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testForceSplit, procId: 103 completed 2023-07-15 19:06:52,085 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testForceSplit get assigned. Timeout = 60000ms 2023-07-15 19:06:52,086 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:52,088 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testForceSplit assigned to meta. Checking AM states. 2023-07-15 19:06:52,088 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:52,088 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testForceSplit assigned. 2023-07-15 19:06:52,104 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6000 Client: jenkins//172.31.14.131 first region in multi=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:52,140 INFO [Listener at localhost/45529] client.TestAdmin1(291): Initial regions (1): [region=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc., hostname=jenkins-hbase4.apache.org,42217,1689447992037, seqNum=2] 2023-07-15 19:06:52,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:52,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:52,160 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:52,160 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(206): testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:52,162 INFO [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.HRegion(2745): Flushing b5aa6755930f3054da47a6f0c6b260cc 2/2 column families, dataSize=181.67 KB heapSize=609.98 KB 2023-07-15 19:06:52,176 INFO [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=31 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/.tmp/cf1/55e69d5f89b14d3981c6aba394630420 2023-07-15 19:06:52,200 INFO [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=181.64 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/.tmp/cf2/841fcf8dbdea485cad589fea7c5f0609 2023-07-15 19:06:52,205 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/.tmp/cf1/55e69d5f89b14d3981c6aba394630420 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1/55e69d5f89b14d3981c6aba394630420 2023-07-15 19:06:52,210 INFO [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1/55e69d5f89b14d3981c6aba394630420, entries=1, sequenceid=6, filesize=4.8 K 2023-07-15 19:06:52,211 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/.tmp/cf2/841fcf8dbdea485cad589fea7c5f0609 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609 2023-07-15 19:06:52,215 INFO [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609, entries=6000, sequenceid=6, filesize=248.5 K 2023-07-15 19:06:52,217 INFO [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.HRegion(2948): Finished flush of dataSize ~181.67 KB/186031, heapSize ~609.95 KB/624584, currentSize=0 B/0 for b5aa6755930f3054da47a6f0c6b260cc in 55ms, sequenceid=6, compaction requested=false 2023-07-15 19:06:52,217 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.HRegion(2446): Flush status journal for b5aa6755930f3054da47a6f0c6b260cc: 2023-07-15 19:06:52,217 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=15,queue=1,port=42217] regionserver.StoreUtils(129): cannot split hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1/55e69d5f89b14d3981c6aba394630420 because midkey is the same as first or last row 2023-07-15 19:06:52,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:52,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=106, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=b5aa6755930f3054da47a6f0c6b260cc, daughterA=256b029b3b1d4db8ba0bc505f350df57, daughterB=9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,220 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=b5aa6755930f3054da47a6f0c6b260cc, daughterA=256b029b3b1d4db8ba0bc505f350df57, daughterB=9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,220 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=b5aa6755930f3054da47a6f0c6b260cc, daughterA=256b029b3b1d4db8ba0bc505f350df57, daughterB=9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,220 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=b5aa6755930f3054da47a6f0c6b260cc, daughterA=256b029b3b1d4db8ba0bc505f350df57, daughterB=9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=107, ppid=106, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=b5aa6755930f3054da47a6f0c6b260cc, UNASSIGN}] 2023-07-15 19:06:52,223 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=106, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=b5aa6755930f3054da47a6f0c6b260cc, UNASSIGN 2023-07-15 19:06:52,224 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b5aa6755930f3054da47a6f0c6b260cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:52,224 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448012224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448012224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448012224"}]},"ts":"1689448012224"} 2023-07-15 19:06:52,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; CloseRegionProcedure b5aa6755930f3054da47a6f0c6b260cc, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:52,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:52,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5aa6755930f3054da47a6f0c6b260cc, disabling compactions & flushes 2023-07-15 19:06:52,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:52,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:52,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. after waiting 0 ms 2023-07-15 19:06:52,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:52,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 19:06:52,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:52,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5aa6755930f3054da47a6f0c6b260cc: 2023-07-15 19:06:52,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:52,387 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b5aa6755930f3054da47a6f0c6b260cc, regionState=CLOSED 2023-07-15 19:06:52,387 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448012387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448012387"}]},"ts":"1689448012387"} 2023-07-15 19:06:52,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-15 19:06:52,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; CloseRegionProcedure b5aa6755930f3054da47a6f0c6b260cc, server=jenkins-hbase4.apache.org,42217,1689447992037 in 164 msec 2023-07-15 19:06:52,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=106 2023-07-15 19:06:52,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=106, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=b5aa6755930f3054da47a6f0c6b260cc, UNASSIGN in 168 msec 2023-07-15 19:06:52,399 INFO [PEWorker-5] assignment.SplitTableRegionProcedure(694): pid=106 splitting 2 storefiles, region=b5aa6755930f3054da47a6f0c6b260cc, threads=2 2023-07-15 19:06:52,399 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=106 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609 for region: b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:52,399 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=106 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1/55e69d5f89b14d3981c6aba394630420 for region: b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:52,403 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(713): Will create HFileLink file for hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1/55e69d5f89b14d3981c6aba394630420, top=false 2023-07-15 19:06:52,407 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/.splits/256b029b3b1d4db8ba0bc505f350df57/cf1/testForceSplit=b5aa6755930f3054da47a6f0c6b260cc-55e69d5f89b14d3981c6aba394630420 for child: 256b029b3b1d4db8ba0bc505f350df57, parent: b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:52,414 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=106 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1/55e69d5f89b14d3981c6aba394630420 for region: b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:52,429 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=106 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609 for region: b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:52,429 DEBUG [PEWorker-5] assignment.SplitTableRegionProcedure(755): pid=106 split storefiles for region b5aa6755930f3054da47a6f0c6b260cc Daughter A: 2 storefiles, Daughter B: 1 storefiles. 2023-07-15 19:06:52,468 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=-1 2023-07-15 19:06:52,471 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=-1 2023-07-15 19:06:52,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448012473"},{"qualifier":"splitA","vlen":52,"tag":[],"timestamp":"1689448012473"},{"qualifier":"splitB","vlen":52,"tag":[],"timestamp":"1689448012473"}]},"ts":"1689448012473"} 2023-07-15 19:06:52,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448012473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448012473"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448012473"}]},"ts":"1689448012473"} 2023-07-15 19:06:52,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448012473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448012473"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448012473"}]},"ts":"1689448012473"} 2023-07-15 19:06:52,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=256b029b3b1d4db8ba0bc505f350df57, ASSIGN}, {pid=110, ppid=106, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=9acec9473540f61ced36e9388c2f5e61, ASSIGN}] 2023-07-15 19:06:52,482 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=110, ppid=106, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=9acec9473540f61ced36e9388c2f5e61, ASSIGN 2023-07-15 19:06:52,482 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=109, ppid=106, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=256b029b3b1d4db8ba0bc505f350df57, ASSIGN 2023-07-15 19:06:52,483 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=110, ppid=106, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=9acec9473540f61ced36e9388c2f5e61, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:52,483 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=109, ppid=106, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=256b029b3b1d4db8ba0bc505f350df57, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:52,633 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 19:06:52,635 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=110 updating hbase:meta row=9acec9473540f61ced36e9388c2f5e61, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:52,635 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=109 updating hbase:meta row=256b029b3b1d4db8ba0bc505f350df57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:52,636 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448012635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448012635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448012635"}]},"ts":"1689448012635"} 2023-07-15 19:06:52,636 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448012635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448012635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448012635"}]},"ts":"1689448012635"} 2023-07-15 19:06:52,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=109, state=RUNNABLE; OpenRegionProcedure 256b029b3b1d4db8ba0bc505f350df57, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:52,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=112, ppid=110, state=RUNNABLE; OpenRegionProcedure 9acec9473540f61ced36e9388c2f5e61, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:52,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 256b029b3b1d4db8ba0bc505f350df57, NAME => 'testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'} 2023-07-15 19:06:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:52,794 INFO [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:52,795 DEBUG [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf1 2023-07-15 19:06:52,795 DEBUG [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf1 2023-07-15 19:06:52,796 INFO [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 256b029b3b1d4db8ba0bc505f350df57 columnFamilyName cf1 2023-07-15 19:06:52,802 DEBUG [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf1/testForceSplit=b5aa6755930f3054da47a6f0c6b260cc-55e69d5f89b14d3981c6aba394630420 2023-07-15 19:06:52,802 INFO [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] regionserver.HStore(310): Store=256b029b3b1d4db8ba0bc505f350df57/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:52,802 INFO [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region 256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:52,803 DEBUG [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2 2023-07-15 19:06:52,803 DEBUG [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2 2023-07-15 19:06:52,803 INFO [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 256b029b3b1d4db8ba0bc505f350df57 columnFamilyName cf2 2023-07-15 19:06:52,814 DEBUG [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609-bottom 2023-07-15 19:06:52,815 INFO [StoreOpener-256b029b3b1d4db8ba0bc505f350df57-1] regionserver.HStore(310): Store=256b029b3b1d4db8ba0bc505f350df57/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:52,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:52,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:52,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:52,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:52,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 256b029b3b1d4db8ba0bc505f350df57; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69007995, jitterRate=0.028299257159233093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:52,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 256b029b3b1d4db8ba0bc505f350df57: 2023-07-15 19:06:52,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57., pid=111, masterSystemTime=1689448012789 2023-07-15 19:06:52,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:52,823 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:52,823 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf2 since it belongs to recently split daughter region testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:52,823 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HStore(1912): 256b029b3b1d4db8ba0bc505f350df57/cf2 is initiating minor compaction (all files) 2023-07-15 19:06:52,823 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 256b029b3b1d4db8ba0bc505f350df57/cf2 in testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:52,823 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609-bottom] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/.tmp, totalSize=248.5 K 2023-07-15 19:06:52,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:52,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:52,824 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] compactions.Compactor(207): Compacting 841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc, keycount=3000, bloomtype=ROW, size=248.5 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689448012114 2023-07-15 19:06:52,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:52,824 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=109 updating hbase:meta row=256b029b3b1d4db8ba0bc505f350df57, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:52,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9acec9473540f61ced36e9388c2f5e61, NAME => 'testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.', STARTKEY => '\x00\x00\x0B\xB8', ENDKEY => ''} 2023-07-15 19:06:52,825 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448012824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448012824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448012824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448012824"}]},"ts":"1689448012824"} 2023-07-15 19:06:52,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:52,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,826 INFO [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=109 2023-07-15 19:06:52,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=109, state=SUCCESS; OpenRegionProcedure 256b029b3b1d4db8ba0bc505f350df57, server=jenkins-hbase4.apache.org,42217,1689447992037 in 189 msec 2023-07-15 19:06:52,828 DEBUG [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf1 2023-07-15 19:06:52,828 DEBUG [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf1 2023-07-15 19:06:52,828 INFO [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9acec9473540f61ced36e9388c2f5e61 columnFamilyName cf1 2023-07-15 19:06:52,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=256b029b3b1d4db8ba0bc505f350df57, ASSIGN in 351 msec 2023-07-15 19:06:52,829 INFO [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] regionserver.HStore(310): Store=9acec9473540f61ced36e9388c2f5e61/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:52,829 INFO [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region 9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,830 DEBUG [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2 2023-07-15 19:06:52,830 DEBUG [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2 2023-07-15 19:06:52,830 INFO [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9acec9473540f61ced36e9388c2f5e61 columnFamilyName cf2 2023-07-15 19:06:52,838 DEBUG [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609-top 2023-07-15 19:06:52,838 INFO [StoreOpener-9acec9473540f61ced36e9388c2f5e61-1] regionserver.HStore(310): Store=9acec9473540f61ced36e9388c2f5e61/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:52,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:52,842 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] throttle.PressureAwareThroughputController(145): 256b029b3b1d4db8ba0bc505f350df57#cf2#compaction#21 average throughput is 6.82 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:52,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:52,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9acec9473540f61ced36e9388c2f5e61; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64238122, jitterRate=-0.04277738928794861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:52,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9acec9473540f61ced36e9388c2f5e61: 2023-07-15 19:06:52,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61., pid=112, masterSystemTime=1689448012789 2023-07-15 19:06:52,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:52,853 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:52,854 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf2 since it belongs to recently split daughter region testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:52,854 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HStore(1912): 9acec9473540f61ced36e9388c2f5e61/cf2 is initiating minor compaction (all files) 2023-07-15 19:06:52,854 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9acec9473540f61ced36e9388c2f5e61/cf2 in testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:52,854 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609-top] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/.tmp, totalSize=248.5 K 2023-07-15 19:06:52,855 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] compactions.Compactor(207): Compacting 841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc, keycount=3000, bloomtype=ROW, size=248.5 K, encoding=NONE, compression=NONE, seqNum=7, earliestPutTs=1689448012114 2023-07-15 19:06:52,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:52,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:52,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=110 updating hbase:meta row=9acec9473540f61ced36e9388c2f5e61, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:52,856 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448012855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448012855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448012855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448012855"}]},"ts":"1689448012855"} 2023-07-15 19:06:52,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=112, resume processing ppid=110 2023-07-15 19:06:52,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, ppid=110, state=SUCCESS; OpenRegionProcedure 9acec9473540f61ced36e9388c2f5e61, server=jenkins-hbase4.apache.org,42217,1689447992037 in 223 msec 2023-07-15 19:06:52,867 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/.tmp/cf2/f4256793607a4139864316c42e7ad772 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2/f4256793607a4139864316c42e7ad772 2023-07-15 19:06:52,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-07-15 19:06:52,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=9acec9473540f61ced36e9388c2f5e61, ASSIGN in 388 msec 2023-07-15 19:06:52,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, state=SUCCESS; SplitTableRegionProcedure table=testForceSplit, parent=b5aa6755930f3054da47a6f0c6b260cc, daughterA=256b029b3b1d4db8ba0bc505f350df57, daughterB=9acec9473540f61ced36e9388c2f5e61 in 649 msec 2023-07-15 19:06:52,871 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] throttle.PressureAwareThroughputController(145): 9acec9473540f61ced36e9388c2f5e61#cf2#compaction#22 average throughput is 8.87 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:52,875 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 256b029b3b1d4db8ba0bc505f350df57/cf2 of 256b029b3b1d4db8ba0bc505f350df57 into f4256793607a4139864316c42e7ad772(size=126.6 K), total size for store is 126.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:52,875 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 256b029b3b1d4db8ba0bc505f350df57: 2023-07-15 19:06:52,875 INFO [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57., storeName=256b029b3b1d4db8ba0bc505f350df57/cf2, priority=15, startTime=1689448012821; duration=0sec 2023-07-15 19:06:52,875 DEBUG [RS:2;jenkins-hbase4:42217-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:52,889 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/.tmp/cf2/71c5833cccd7410c9012fe33b1fb49c6 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2/71c5833cccd7410c9012fe33b1fb49c6 2023-07-15 19:06:52,896 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 9acec9473540f61ced36e9388c2f5e61/cf2 of 9acec9473540f61ced36e9388c2f5e61 into 71c5833cccd7410c9012fe33b1fb49c6(size=126.6 K), total size for store is 126.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:52,896 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9acec9473540f61ced36e9388c2f5e61: 2023-07-15 19:06:52,896 INFO [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61., storeName=9acec9473540f61ced36e9388c2f5e61/cf2, priority=15, startTime=1689448012846; duration=0sec 2023-07-15 19:06:52,896 DEBUG [RS:2;jenkins-hbase4:42217-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:53,224 INFO [CheckForSplit] client.TestAdmin1$1(333): Found: [region=testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57., hostname=jenkins-hbase4.apache.org,42217,1689447992037, seqNum=10, region=testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61., hostname=jenkins-hbase4.apache.org,42217,1689447992037, seqNum=10] 2023-07-15 19:06:53,224 DEBUG [CheckForSplit] client.TestAdmin1$1(338): CheckForSplit thread exited, current region count: 2 2023-07-15 19:06:53,225 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.RSRpcServices(3109): Region has changed on the scanner -1455325848360976377: regionName=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc., scannerRegionName=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc., closing... 2023-07-15 19:06:53,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] ipc.CallRunner(144): callId: 361 service: ClientService methodName: Scan size: 48 connection: 172.31.14.131:42770 deadline: 1689448073225, exception=org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -1455325848360976377: regionName=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc., scannerRegionName=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. 2023-07-15 19:06:53,227 DEBUG [Listener at localhost/45529] client.ScannerCallableWithReplicas(204): Scan with primary region returns org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:228) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:258) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:58) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:124) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:393) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:367) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -1455325848360976377: regionName=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc., scannerRegionName=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:194) ... 11 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -1455325848360976377: regionName=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc., scannerRegionName=testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-15 19:06:53,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:53,245 DEBUG [Listener at localhost/45529] client.ClientScanner(240): Advancing internal scanner to startKey at '\x00\x00\x0B\xB8', inclusive 2023-07-15 19:06:53,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=42217] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:53,262 DEBUG [Listener at localhost/45529] client.TestAdmin1(373): SplitKey=3000&deltaForLargestFamily=0, r={ENCODED => 256b029b3b1d4db8ba0bc505f350df57, NAME => 'testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'} 2023-07-15 19:06:53,263 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testForceSplit 2023-07-15 19:06:53,263 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testForceSplit 2023-07-15 19:06:53,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testForceSplit 2023-07-15 19:06:53,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=113 2023-07-15 19:06:53,267 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448013267"}]},"ts":"1689448013267"} 2023-07-15 19:06:53,268 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLING in hbase:meta 2023-07-15 19:06:53,270 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testForceSplit to state=DISABLING 2023-07-15 19:06:53,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=9acec9473540f61ced36e9388c2f5e61, UNASSIGN}, {pid=115, ppid=113, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=256b029b3b1d4db8ba0bc505f350df57, UNASSIGN}] 2023-07-15 19:06:53,272 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=114, ppid=113, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=9acec9473540f61ced36e9388c2f5e61, UNASSIGN 2023-07-15 19:06:53,273 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=113, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=256b029b3b1d4db8ba0bc505f350df57, UNASSIGN 2023-07-15 19:06:53,273 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=114 updating hbase:meta row=9acec9473540f61ced36e9388c2f5e61, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:53,273 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=256b029b3b1d4db8ba0bc505f350df57, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:53,273 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448013273"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448013273"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448013273"}]},"ts":"1689448013273"} 2023-07-15 19:06:53,273 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448013273"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448013273"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448013273"}]},"ts":"1689448013273"} 2023-07-15 19:06:53,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=116, ppid=114, state=RUNNABLE; CloseRegionProcedure 9acec9473540f61ced36e9388c2f5e61, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:53,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 256b029b3b1d4db8ba0bc505f350df57, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:53,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:53,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9acec9473540f61ced36e9388c2f5e61, disabling compactions & flushes 2023-07-15 19:06:53,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:53,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:53,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. after waiting 0 ms 2023-07-15 19:06:53,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:53,432 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609-top] to archive 2023-07-15 19:06:53,433 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:53,436 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:53,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=9 2023-07-15 19:06:53,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61. 2023-07-15 19:06:53,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9acec9473540f61ced36e9388c2f5e61: 2023-07-15 19:06:53,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:53,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:53,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 256b029b3b1d4db8ba0bc505f350df57, disabling compactions & flushes 2023-07-15 19:06:53,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:53,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:53,445 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=114 updating hbase:meta row=9acec9473540f61ced36e9388c2f5e61, regionState=CLOSED 2023-07-15 19:06:53,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. after waiting 0 ms 2023-07-15 19:06:53,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:53,445 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448013445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448013445"}]},"ts":"1689448013445"} 2023-07-15 19:06:53,450 DEBUG [StoreCloser-testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609-bottom] to archive 2023-07-15 19:06:53,450 DEBUG [StoreCloser-testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:53,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-15 19:06:53,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; CloseRegionProcedure 9acec9473540f61ced36e9388c2f5e61, server=jenkins-hbase4.apache.org,42217,1689447992037 in 175 msec 2023-07-15 19:06:53,453 DEBUG [StoreCloser-testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2/841fcf8dbdea485cad589fea7c5f0609.b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:53,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=9acec9473540f61ced36e9388c2f5e61, UNASSIGN in 181 msec 2023-07-15 19:06:53,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=9 2023-07-15 19:06:53,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57. 2023-07-15 19:06:53,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 256b029b3b1d4db8ba0bc505f350df57: 2023-07-15 19:06:53,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:53,462 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=256b029b3b1d4db8ba0bc505f350df57, regionState=CLOSED 2023-07-15 19:06:53,462 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448013462"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448013462"}]},"ts":"1689448013462"} 2023-07-15 19:06:53,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-15 19:06:53,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 256b029b3b1d4db8ba0bc505f350df57, server=jenkins-hbase4.apache.org,42217,1689447992037 in 188 msec 2023-07-15 19:06:53,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=113 2023-07-15 19:06:53,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=113, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=256b029b3b1d4db8ba0bc505f350df57, UNASSIGN in 194 msec 2023-07-15 19:06:53,466 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448013466"}]},"ts":"1689448013466"} 2023-07-15 19:06:53,468 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLED in hbase:meta 2023-07-15 19:06:53,469 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testForceSplit to state=DISABLED 2023-07-15 19:06:53,471 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; DisableTableProcedure table=testForceSplit in 206 msec 2023-07-15 19:06:53,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=113 2023-07-15 19:06:53,518 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testForceSplit, procId: 113 completed 2023-07-15 19:06:53,519 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testForceSplit 2023-07-15 19:06:53,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=118, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:53,522 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=118, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:53,524 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=118, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:53,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=118 2023-07-15 19:06:53,528 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:53,528 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:53,528 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:53,531 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/recovered.edits] 2023-07-15 19:06:53,531 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/recovered.edits] 2023-07-15 19:06:53,531 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/recovered.edits] 2023-07-15 19:06:53,534 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1/55e69d5f89b14d3981c6aba394630420 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf1/55e69d5f89b14d3981c6aba394630420 2023-07-15 19:06:53,535 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf1/testForceSplit=b5aa6755930f3054da47a6f0c6b260cc-55e69d5f89b14d3981c6aba394630420 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf1/testForceSplit=b5aa6755930f3054da47a6f0c6b260cc-55e69d5f89b14d3981c6aba394630420 2023-07-15 19:06:53,535 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2/71c5833cccd7410c9012fe33b1fb49c6 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/cf2/71c5833cccd7410c9012fe33b1fb49c6 2023-07-15 19:06:53,538 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/cf2/841fcf8dbdea485cad589fea7c5f0609 2023-07-15 19:06:53,538 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2/f4256793607a4139864316c42e7ad772 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/cf2/f4256793607a4139864316c42e7ad772 2023-07-15 19:06:53,539 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/recovered.edits/13.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61/recovered.edits/13.seqid 2023-07-15 19:06:53,540 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/9acec9473540f61ced36e9388c2f5e61 2023-07-15 19:06:53,542 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/recovered.edits/9.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc/recovered.edits/9.seqid 2023-07-15 19:06:53,542 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/recovered.edits/13.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57/recovered.edits/13.seqid 2023-07-15 19:06:53,542 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b5aa6755930f3054da47a6f0c6b260cc 2023-07-15 19:06:53,543 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/256b029b3b1d4db8ba0bc505f350df57 2023-07-15 19:06:53,543 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:53,545 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=118, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:53,547 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testForceSplit from hbase:meta 2023-07-15 19:06:53,549 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testForceSplit' descriptor. 2023-07-15 19:06:53,550 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=118, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:53,550 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testForceSplit' from region states. 2023-07-15 19:06:53,550 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448013550"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:53,550 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448013550"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:53,550 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448013550"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:53,551 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-15 19:06:53,551 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9acec9473540f61ced36e9388c2f5e61, NAME => 'testForceSplit,\x00\x00\x0B\xB8,1689448012218.9acec9473540f61ced36e9388c2f5e61.', STARTKEY => '\x00\x00\x0B\xB8', ENDKEY => ''}, {ENCODED => b5aa6755930f3054da47a6f0c6b260cc, NAME => 'testForceSplit,,1689448011328.b5aa6755930f3054da47a6f0c6b260cc.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 256b029b3b1d4db8ba0bc505f350df57, NAME => 'testForceSplit,,1689448012218.256b029b3b1d4db8ba0bc505f350df57.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'}] 2023-07-15 19:06:53,551 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testForceSplit' as deleted. 2023-07-15 19:06:53,551 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448013551"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:53,552 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testForceSplit state from META 2023-07-15 19:06:53,556 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=118, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:53,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, state=SUCCESS; DeleteTableProcedure table=testForceSplit in 38 msec 2023-07-15 19:06:53,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=118 2023-07-15 19:06:53,775 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testForceSplit, procId: 118 completed 2023-07-15 19:06:53,777 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf1 must be between 1K and 16MB. 2023-07-15 19:06:53,777 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf2 must be between 1K and 16MB. 2023-07-15 19:06:53,777 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testForceSplit', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, {NAME => 'cf2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:53,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testForceSplit 2023-07-15 19:06:53,780 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=119, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:53,780 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testForceSplit" procId is: 119 2023-07-15 19:06:53,781 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=119, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:53,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 19:06:53,782 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:53,783 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec empty. 2023-07-15 19:06:53,783 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:53,784 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:53,799 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:53,800 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => 24151f3340083896622f4b47a76c05ec, NAME => 'testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testForceSplit', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, {NAME => 'cf2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:53,809 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:53,809 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1604): Closing 24151f3340083896622f4b47a76c05ec, disabling compactions & flushes 2023-07-15 19:06:53,809 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:53,809 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:53,809 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. after waiting 0 ms 2023-07-15 19:06:53,809 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:53,809 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:53,809 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1558): Region close journal for 24151f3340083896622f4b47a76c05ec: 2023-07-15 19:06:53,811 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=119, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:53,812 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448013812"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448013812"}]},"ts":"1689448013812"} 2023-07-15 19:06:53,813 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:53,814 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=119, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:53,814 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448013814"}]},"ts":"1689448013814"} 2023-07-15 19:06:53,815 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLING in hbase:meta 2023-07-15 19:06:53,818 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:53,819 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:53,819 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:53,819 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:53,819 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:53,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=24151f3340083896622f4b47a76c05ec, ASSIGN}] 2023-07-15 19:06:53,821 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=120, ppid=119, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=24151f3340083896622f4b47a76c05ec, ASSIGN 2023-07-15 19:06:53,823 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=120, ppid=119, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=24151f3340083896622f4b47a76c05ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:53,973 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:53,974 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=120 updating hbase:meta row=24151f3340083896622f4b47a76c05ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:53,975 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448013974"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448013974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448013974"}]},"ts":"1689448013974"} 2023-07-15 19:06:53,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=120, state=RUNNABLE; OpenRegionProcedure 24151f3340083896622f4b47a76c05ec, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:54,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 19:06:54,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 24151f3340083896622f4b47a76c05ec, NAME => 'testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,133 INFO [StoreOpener-24151f3340083896622f4b47a76c05ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,134 DEBUG [StoreOpener-24151f3340083896622f4b47a76c05ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1 2023-07-15 19:06:54,134 DEBUG [StoreOpener-24151f3340083896622f4b47a76c05ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1 2023-07-15 19:06:54,135 INFO [StoreOpener-24151f3340083896622f4b47a76c05ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24151f3340083896622f4b47a76c05ec columnFamilyName cf1 2023-07-15 19:06:54,135 INFO [StoreOpener-24151f3340083896622f4b47a76c05ec-1] regionserver.HStore(310): Store=24151f3340083896622f4b47a76c05ec/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:54,135 INFO [StoreOpener-24151f3340083896622f4b47a76c05ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,137 DEBUG [StoreOpener-24151f3340083896622f4b47a76c05ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2 2023-07-15 19:06:54,137 DEBUG [StoreOpener-24151f3340083896622f4b47a76c05ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2 2023-07-15 19:06:54,137 INFO [StoreOpener-24151f3340083896622f4b47a76c05ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24151f3340083896622f4b47a76c05ec columnFamilyName cf2 2023-07-15 19:06:54,138 INFO [StoreOpener-24151f3340083896622f4b47a76c05ec-1] regionserver.HStore(310): Store=24151f3340083896622f4b47a76c05ec/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:54,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:54,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:54,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 24151f3340083896622f4b47a76c05ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74585978, jitterRate=0.11141768097877502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:54,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 24151f3340083896622f4b47a76c05ec: 2023-07-15 19:06:54,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec., pid=121, masterSystemTime=1689448014127 2023-07-15 19:06:54,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,147 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=120 updating hbase:meta row=24151f3340083896622f4b47a76c05ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:54,147 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448014147"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448014147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448014147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448014147"}]},"ts":"1689448014147"} 2023-07-15 19:06:54,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=120 2023-07-15 19:06:54,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=120, state=SUCCESS; OpenRegionProcedure 24151f3340083896622f4b47a76c05ec, server=jenkins-hbase4.apache.org,36223,1689447992001 in 173 msec 2023-07-15 19:06:54,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-07-15 19:06:54,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=24151f3340083896622f4b47a76c05ec, ASSIGN in 331 msec 2023-07-15 19:06:54,152 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=119, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:54,152 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448014152"}]},"ts":"1689448014152"} 2023-07-15 19:06:54,153 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLED in hbase:meta 2023-07-15 19:06:54,156 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=119, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:54,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; CreateTableProcedure table=testForceSplit in 379 msec 2023-07-15 19:06:54,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 19:06:54,534 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testForceSplit, procId: 119 completed 2023-07-15 19:06:54,534 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testForceSplit get assigned. Timeout = 60000ms 2023-07-15 19:06:54,534 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:54,536 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testForceSplit assigned to meta. Checking AM states. 2023-07-15 19:06:54,537 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:54,537 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testForceSplit assigned. 2023-07-15 19:06:54,551 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6000 Client: jenkins//172.31.14.131 first region in multi=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,582 INFO [Listener at localhost/45529] client.TestAdmin1(291): Initial regions (1): [region=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=2] 2023-07-15 19:06:54,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:54,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:54,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:54,602 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,602 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(206): testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:54,604 INFO [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.HRegion(2745): Flushing 24151f3340083896622f4b47a76c05ec 2/2 column families, dataSize=190.72 KB heapSize=640.34 KB 2023-07-15 19:06:54,623 INFO [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=181.64 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/.tmp/cf1/4405b04e30b14aa8b82d176019318715 2023-07-15 19:06:54,648 INFO [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=9.08 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/.tmp/cf2/fee70ee6396e4ff2910e0584488b837a 2023-07-15 19:06:54,654 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/.tmp/cf1/4405b04e30b14aa8b82d176019318715 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715 2023-07-15 19:06:54,659 INFO [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715, entries=6000, sequenceid=6, filesize=248.5 K 2023-07-15 19:06:54,661 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/.tmp/cf2/fee70ee6396e4ff2910e0584488b837a as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2/fee70ee6396e4ff2910e0584488b837a 2023-07-15 19:06:54,665 INFO [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2/fee70ee6396e4ff2910e0584488b837a, entries=300, sequenceid=6, filesize=17.0 K 2023-07-15 19:06:54,666 INFO [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.HRegion(2948): Finished flush of dataSize ~190.72 KB/195300, heapSize ~640.31 KB/655680, currentSize=0 B/0 for 24151f3340083896622f4b47a76c05ec in 62ms, sequenceid=6, compaction requested=false 2023-07-15 19:06:54,666 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=18,queue=2,port=36223] regionserver.HRegion(2446): Flush status journal for 24151f3340083896622f4b47a76c05ec: 2023-07-15 19:06:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:54,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=122, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=24151f3340083896622f4b47a76c05ec, daughterA=ea3d8476476263d2ee64f5ca86ee59df, daughterB=b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:54,669 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=122, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=24151f3340083896622f4b47a76c05ec, daughterA=ea3d8476476263d2ee64f5ca86ee59df, daughterB=b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:54,669 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=122, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=24151f3340083896622f4b47a76c05ec, daughterA=ea3d8476476263d2ee64f5ca86ee59df, daughterB=b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:54,669 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=122, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=24151f3340083896622f4b47a76c05ec, daughterA=ea3d8476476263d2ee64f5ca86ee59df, daughterB=b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:54,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=123, ppid=122, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=24151f3340083896622f4b47a76c05ec, UNASSIGN}] 2023-07-15 19:06:54,672 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=123, ppid=122, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=24151f3340083896622f4b47a76c05ec, UNASSIGN 2023-07-15 19:06:54,672 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=123 updating hbase:meta row=24151f3340083896622f4b47a76c05ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:54,672 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448014672"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448014672"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448014672"}]},"ts":"1689448014672"} 2023-07-15 19:06:54,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=124, ppid=123, state=RUNNABLE; CloseRegionProcedure 24151f3340083896622f4b47a76c05ec, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:54,712 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 19:06:54,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 24151f3340083896622f4b47a76c05ec, disabling compactions & flushes 2023-07-15 19:06:54,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. after waiting 0 ms 2023-07-15 19:06:54,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 19:06:54,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:54,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 24151f3340083896622f4b47a76c05ec: 2023-07-15 19:06:54,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,836 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=123 updating hbase:meta row=24151f3340083896622f4b47a76c05ec, regionState=CLOSED 2023-07-15 19:06:54,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448014836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448014836"}]},"ts":"1689448014836"} 2023-07-15 19:06:54,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=124, resume processing ppid=123 2023-07-15 19:06:54,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=124, ppid=123, state=SUCCESS; CloseRegionProcedure 24151f3340083896622f4b47a76c05ec, server=jenkins-hbase4.apache.org,36223,1689447992001 in 164 msec 2023-07-15 19:06:54,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=123, resume processing ppid=122 2023-07-15 19:06:54,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, ppid=122, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=24151f3340083896622f4b47a76c05ec, UNASSIGN in 168 msec 2023-07-15 19:06:54,847 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=122 splitting 2 storefiles, region=24151f3340083896622f4b47a76c05ec, threads=2 2023-07-15 19:06:54,848 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=122 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2/fee70ee6396e4ff2910e0584488b837a for region: 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,848 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=122 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715 for region: 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,852 DEBUG [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(713): Will create HFileLink file for hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2/fee70ee6396e4ff2910e0584488b837a, top=false 2023-07-15 19:06:54,856 INFO [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/.splits/ea3d8476476263d2ee64f5ca86ee59df/cf2/testForceSplit=24151f3340083896622f4b47a76c05ec-fee70ee6396e4ff2910e0584488b837a for child: ea3d8476476263d2ee64f5ca86ee59df, parent: 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,860 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=122 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2/fee70ee6396e4ff2910e0584488b837a for region: 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,870 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=122 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715 for region: 24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:54,870 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=122 split storefiles for region 24151f3340083896622f4b47a76c05ec Daughter A: 2 storefiles, Daughter B: 1 storefiles. 2023-07-15 19:06:54,894 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=-1 2023-07-15 19:06:54,896 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=-1 2023-07-15 19:06:54,897 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448014897"},{"qualifier":"splitA","vlen":52,"tag":[],"timestamp":"1689448014897"},{"qualifier":"splitB","vlen":52,"tag":[],"timestamp":"1689448014897"}]},"ts":"1689448014897"} 2023-07-15 19:06:54,897 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448014897"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448014897"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448014897"}]},"ts":"1689448014897"} 2023-07-15 19:06:54,897 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448014897"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448014897"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448014897"}]},"ts":"1689448014897"} 2023-07-15 19:06:54,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=125, ppid=122, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=ea3d8476476263d2ee64f5ca86ee59df, ASSIGN}, {pid=126, ppid=122, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=b8aa3d81c77328df2b8fc3e16b469e78, ASSIGN}] 2023-07-15 19:06:54,901 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=125, ppid=122, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=ea3d8476476263d2ee64f5ca86ee59df, ASSIGN 2023-07-15 19:06:54,901 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=126, ppid=122, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=b8aa3d81c77328df2b8fc3e16b469e78, ASSIGN 2023-07-15 19:06:54,901 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=125, ppid=122, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=ea3d8476476263d2ee64f5ca86ee59df, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:54,901 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=126, ppid=122, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=b8aa3d81c77328df2b8fc3e16b469e78, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:55,051 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 19:06:55,054 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=125 updating hbase:meta row=ea3d8476476263d2ee64f5ca86ee59df, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:55,054 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=126 updating hbase:meta row=b8aa3d81c77328df2b8fc3e16b469e78, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:55,054 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448015054"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448015054"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448015054"}]},"ts":"1689448015054"} 2023-07-15 19:06:55,054 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448015054"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448015054"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448015054"}]},"ts":"1689448015054"} 2023-07-15 19:06:55,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=127, ppid=125, state=RUNNABLE; OpenRegionProcedure ea3d8476476263d2ee64f5ca86ee59df, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:55,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=128, ppid=126, state=RUNNABLE; OpenRegionProcedure b8aa3d81c77328df2b8fc3e16b469e78, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:55,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea3d8476476263d2ee64f5ca86ee59df, NAME => 'testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'} 2023-07-15 19:06:55,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:55,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,211 INFO [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,212 DEBUG [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1 2023-07-15 19:06:55,212 DEBUG [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1 2023-07-15 19:06:55,213 INFO [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea3d8476476263d2ee64f5ca86ee59df columnFamilyName cf1 2023-07-15 19:06:55,222 DEBUG [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715-bottom 2023-07-15 19:06:55,222 INFO [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] regionserver.HStore(310): Store=ea3d8476476263d2ee64f5ca86ee59df/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:55,222 INFO [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,223 DEBUG [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf2 2023-07-15 19:06:55,223 DEBUG [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf2 2023-07-15 19:06:55,223 INFO [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea3d8476476263d2ee64f5ca86ee59df columnFamilyName cf2 2023-07-15 19:06:55,228 DEBUG [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf2/testForceSplit=24151f3340083896622f4b47a76c05ec-fee70ee6396e4ff2910e0584488b837a 2023-07-15 19:06:55,228 INFO [StoreOpener-ea3d8476476263d2ee64f5ca86ee59df-1] regionserver.HStore(310): Store=ea3d8476476263d2ee64f5ca86ee59df/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:55,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:55,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea3d8476476263d2ee64f5ca86ee59df; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62575855, jitterRate=-0.06754709780216217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:55,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea3d8476476263d2ee64f5ca86ee59df: 2023-07-15 19:06:55,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df., pid=127, masterSystemTime=1689448015207 2023-07-15 19:06:55,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:55,236 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:55,237 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf1 since it belongs to recently split daughter region testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,237 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1912): ea3d8476476263d2ee64f5ca86ee59df/cf1 is initiating minor compaction (all files) 2023-07-15 19:06:55,237 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ea3d8476476263d2ee64f5ca86ee59df/cf1 in testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,237 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715-bottom] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/.tmp, totalSize=248.5 K 2023-07-15 19:06:55,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b8aa3d81c77328df2b8fc3e16b469e78, NAME => 'testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.', STARTKEY => '\x00\x00\x0B\xB8', ENDKEY => ''} 2023-07-15 19:06:55,238 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=125 updating hbase:meta row=ea3d8476476263d2ee64f5ca86ee59df, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:55,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,238 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448015238"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448015238"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448015238"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448015238"}]},"ts":"1689448015238"} 2023-07-15 19:06:55,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:55,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,238 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] compactions.Compactor(207): Compacting 4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec, keycount=3000, bloomtype=ROW, size=248.5 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689448014559 2023-07-15 19:06:55,240 INFO [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,241 DEBUG [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1 2023-07-15 19:06:55,241 DEBUG [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1 2023-07-15 19:06:55,241 INFO [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8aa3d81c77328df2b8fc3e16b469e78 columnFamilyName cf1 2023-07-15 19:06:55,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=127, resume processing ppid=125 2023-07-15 19:06:55,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=127, ppid=125, state=SUCCESS; OpenRegionProcedure ea3d8476476263d2ee64f5ca86ee59df, server=jenkins-hbase4.apache.org,36223,1689447992001 in 185 msec 2023-07-15 19:06:55,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=125, ppid=122, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=ea3d8476476263d2ee64f5ca86ee59df, ASSIGN in 341 msec 2023-07-15 19:06:55,249 DEBUG [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715-top 2023-07-15 19:06:55,250 INFO [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] regionserver.HStore(310): Store=b8aa3d81c77328df2b8fc3e16b469e78/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:55,250 INFO [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,252 DEBUG [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf2 2023-07-15 19:06:55,253 DEBUG [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf2 2023-07-15 19:06:55,253 INFO [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8aa3d81c77328df2b8fc3e16b469e78 columnFamilyName cf2 2023-07-15 19:06:55,254 INFO [StoreOpener-b8aa3d81c77328df2b8fc3e16b469e78-1] regionserver.HStore(310): Store=b8aa3d81c77328df2b8fc3e16b469e78/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:55,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,255 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] throttle.PressureAwareThroughputController(145): ea3d8476476263d2ee64f5ca86ee59df#cf1#compaction#25 average throughput is 8.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:55,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:55,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b8aa3d81c77328df2b8fc3e16b469e78; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70162158, jitterRate=0.045497626066207886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:55,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b8aa3d81c77328df2b8fc3e16b469e78: 2023-07-15 19:06:55,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78., pid=128, masterSystemTime=1689448015207 2023-07-15 19:06:55,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-15 19:06:55,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,265 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=126 updating hbase:meta row=b8aa3d81c77328df2b8fc3e16b469e78, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:55,265 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448015264"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448015264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448015264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448015264"}]},"ts":"1689448015264"} 2023-07-15 19:06:55,267 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:55,268 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf1 since it belongs to recently split daughter region testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,268 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1912): b8aa3d81c77328df2b8fc3e16b469e78/cf1 is initiating minor compaction (all files) 2023-07-15 19:06:55,268 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b8aa3d81c77328df2b8fc3e16b469e78/cf1 in testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=128, resume processing ppid=126 2023-07-15 19:06:55,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=128, ppid=126, state=SUCCESS; OpenRegionProcedure b8aa3d81c77328df2b8fc3e16b469e78, server=jenkins-hbase4.apache.org,36223,1689447992001 in 211 msec 2023-07-15 19:06:55,269 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715-top] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/.tmp, totalSize=248.5 K 2023-07-15 19:06:55,269 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] compactions.Compactor(207): Compacting 4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec, keycount=3000, bloomtype=ROW, size=248.5 K, encoding=NONE, compression=NONE, seqNum=7, earliestPutTs=1689448014559 2023-07-15 19:06:55,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=126, resume processing ppid=122 2023-07-15 19:06:55,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=126, ppid=122, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=b8aa3d81c77328df2b8fc3e16b469e78, ASSIGN in 369 msec 2023-07-15 19:06:55,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, state=SUCCESS; SplitTableRegionProcedure table=testForceSplit, parent=24151f3340083896622f4b47a76c05ec, daughterA=ea3d8476476263d2ee64f5ca86ee59df, daughterB=b8aa3d81c77328df2b8fc3e16b469e78 in 604 msec 2023-07-15 19:06:55,278 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/.tmp/cf1/f766c5d1536c42a58d53221f9931052e as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1/f766c5d1536c42a58d53221f9931052e 2023-07-15 19:06:55,283 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] throttle.PressureAwareThroughputController(145): b8aa3d81c77328df2b8fc3e16b469e78#cf1#compaction#26 average throughput is 9.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:55,287 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in ea3d8476476263d2ee64f5ca86ee59df/cf1 of ea3d8476476263d2ee64f5ca86ee59df into f766c5d1536c42a58d53221f9931052e(size=126.6 K), total size for store is 126.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:55,287 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ea3d8476476263d2ee64f5ca86ee59df: 2023-07-15 19:06:55,287 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df., storeName=ea3d8476476263d2ee64f5ca86ee59df/cf1, priority=15, startTime=1689448015235; duration=0sec 2023-07-15 19:06:55,287 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:55,302 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/.tmp/cf1/890c8583d7fb4a0c944c0963f72b6fb8 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1/890c8583d7fb4a0c944c0963f72b6fb8 2023-07-15 19:06:55,308 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in b8aa3d81c77328df2b8fc3e16b469e78/cf1 of b8aa3d81c77328df2b8fc3e16b469e78 into 890c8583d7fb4a0c944c0963f72b6fb8(size=126.6 K), total size for store is 126.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:55,308 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b8aa3d81c77328df2b8fc3e16b469e78: 2023-07-15 19:06:55,309 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78., storeName=b8aa3d81c77328df2b8fc3e16b469e78/cf1, priority=15, startTime=1689448015263; duration=0sec 2023-07-15 19:06:55,309 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:55,673 INFO [CheckForSplit] client.TestAdmin1$1(333): Found: [region=testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=10, region=testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=10] 2023-07-15 19:06:55,673 DEBUG [CheckForSplit] client.TestAdmin1$1(338): CheckForSplit thread exited, current region count: 2 2023-07-15 19:06:55,673 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.RSRpcServices(3109): Region has changed on the scanner -6449571020524224501: regionName=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec., scannerRegionName=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec., closing... 2023-07-15 19:06:55,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] ipc.CallRunner(144): callId: 405 service: ClientService methodName: Scan size: 48 connection: 172.31.14.131:53184 deadline: 1689448075673, exception=org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224501: regionName=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec., scannerRegionName=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. 2023-07-15 19:06:55,677 DEBUG [Listener at localhost/45529] client.ScannerCallableWithReplicas(204): Scan with primary region returns org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:228) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:258) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:58) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:124) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:393) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:367) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224501: regionName=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec., scannerRegionName=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:194) ... 11 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224501: regionName=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec., scannerRegionName=testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-15 19:06:55,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:55,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:55,698 DEBUG [Listener at localhost/45529] client.ClientScanner(240): Advancing internal scanner to startKey at '\x00\x00\x0B\xB8', inclusive 2023-07-15 19:06:55,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:55,714 DEBUG [Listener at localhost/45529] client.TestAdmin1(373): SplitKey=3000&deltaForLargestFamily=0, r={ENCODED => ea3d8476476263d2ee64f5ca86ee59df, NAME => 'testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'} 2023-07-15 19:06:55,715 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testForceSplit 2023-07-15 19:06:55,715 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testForceSplit 2023-07-15 19:06:55,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=129, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testForceSplit 2023-07-15 19:06:55,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=129 2023-07-15 19:06:55,719 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448015719"}]},"ts":"1689448015719"} 2023-07-15 19:06:55,720 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLING in hbase:meta 2023-07-15 19:06:55,724 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testForceSplit to state=DISABLING 2023-07-15 19:06:55,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=130, ppid=129, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=b8aa3d81c77328df2b8fc3e16b469e78, UNASSIGN}, {pid=131, ppid=129, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=ea3d8476476263d2ee64f5ca86ee59df, UNASSIGN}] 2023-07-15 19:06:55,727 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=130, ppid=129, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=b8aa3d81c77328df2b8fc3e16b469e78, UNASSIGN 2023-07-15 19:06:55,727 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=131, ppid=129, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=ea3d8476476263d2ee64f5ca86ee59df, UNASSIGN 2023-07-15 19:06:55,727 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=130 updating hbase:meta row=b8aa3d81c77328df2b8fc3e16b469e78, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:55,728 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448015727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448015727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448015727"}]},"ts":"1689448015727"} 2023-07-15 19:06:55,728 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=131 updating hbase:meta row=ea3d8476476263d2ee64f5ca86ee59df, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:55,728 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448015728"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448015728"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448015728"}]},"ts":"1689448015728"} 2023-07-15 19:06:55,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=132, ppid=130, state=RUNNABLE; CloseRegionProcedure b8aa3d81c77328df2b8fc3e16b469e78, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:55,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=133, ppid=131, state=RUNNABLE; CloseRegionProcedure ea3d8476476263d2ee64f5ca86ee59df, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:55,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b8aa3d81c77328df2b8fc3e16b469e78, disabling compactions & flushes 2023-07-15 19:06:55,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. after waiting 0 ms 2023-07-15 19:06:55,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,884 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715-top] to archive 2023-07-15 19:06:55,885 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:55,888 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:55,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=9 2023-07-15 19:06:55,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78. 2023-07-15 19:06:55,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b8aa3d81c77328df2b8fc3e16b469e78: 2023-07-15 19:06:55,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea3d8476476263d2ee64f5ca86ee59df, disabling compactions & flushes 2023-07-15 19:06:55,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. after waiting 0 ms 2023-07-15 19:06:55,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,895 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=130 updating hbase:meta row=b8aa3d81c77328df2b8fc3e16b469e78, regionState=CLOSED 2023-07-15 19:06:55,899 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448015895"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448015895"}]},"ts":"1689448015895"} 2023-07-15 19:06:55,899 DEBUG [StoreCloser-testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715-bottom] to archive 2023-07-15 19:06:55,900 DEBUG [StoreCloser-testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:55,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=132, resume processing ppid=130 2023-07-15 19:06:55,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=132, ppid=130, state=SUCCESS; CloseRegionProcedure b8aa3d81c77328df2b8fc3e16b469e78, server=jenkins-hbase4.apache.org,36223,1689447992001 in 171 msec 2023-07-15 19:06:55,902 DEBUG [StoreCloser-testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1/4405b04e30b14aa8b82d176019318715.24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:55,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=130, ppid=129, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=b8aa3d81c77328df2b8fc3e16b469e78, UNASSIGN in 177 msec 2023-07-15 19:06:55,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=9 2023-07-15 19:06:55,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df. 2023-07-15 19:06:55,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea3d8476476263d2ee64f5ca86ee59df: 2023-07-15 19:06:55,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,908 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=131 updating hbase:meta row=ea3d8476476263d2ee64f5ca86ee59df, regionState=CLOSED 2023-07-15 19:06:55,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448015908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448015908"}]},"ts":"1689448015908"} 2023-07-15 19:06:55,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=133, resume processing ppid=131 2023-07-15 19:06:55,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=133, ppid=131, state=SUCCESS; CloseRegionProcedure ea3d8476476263d2ee64f5ca86ee59df, server=jenkins-hbase4.apache.org,36223,1689447992001 in 180 msec 2023-07-15 19:06:55,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=131, resume processing ppid=129 2023-07-15 19:06:55,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=131, ppid=129, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=ea3d8476476263d2ee64f5ca86ee59df, UNASSIGN in 185 msec 2023-07-15 19:06:55,912 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448015912"}]},"ts":"1689448015912"} 2023-07-15 19:06:55,913 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLED in hbase:meta 2023-07-15 19:06:55,915 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testForceSplit to state=DISABLED 2023-07-15 19:06:55,916 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=129, state=SUCCESS; DisableTableProcedure table=testForceSplit in 200 msec 2023-07-15 19:06:55,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=129 2023-07-15 19:06:55,970 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testForceSplit, procId: 129 completed 2023-07-15 19:06:55,971 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testForceSplit 2023-07-15 19:06:55,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=134, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:55,973 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=134, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:55,974 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=134, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:55,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=134 2023-07-15 19:06:55,978 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,978 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,978 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:55,980 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/recovered.edits] 2023-07-15 19:06:55,980 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/recovered.edits] 2023-07-15 19:06:55,981 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/recovered.edits] 2023-07-15 19:06:55,984 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1/890c8583d7fb4a0c944c0963f72b6fb8 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/cf1/890c8583d7fb4a0c944c0963f72b6fb8 2023-07-15 19:06:55,984 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1/f766c5d1536c42a58d53221f9931052e to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf1/f766c5d1536c42a58d53221f9931052e 2023-07-15 19:06:55,984 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf1/4405b04e30b14aa8b82d176019318715 2023-07-15 19:06:55,987 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2/fee70ee6396e4ff2910e0584488b837a to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/cf2/fee70ee6396e4ff2910e0584488b837a 2023-07-15 19:06:55,987 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf2/testForceSplit=24151f3340083896622f4b47a76c05ec-fee70ee6396e4ff2910e0584488b837a to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/cf2/testForceSplit=24151f3340083896622f4b47a76c05ec-fee70ee6396e4ff2910e0584488b837a 2023-07-15 19:06:55,988 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/recovered.edits/13.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78/recovered.edits/13.seqid 2023-07-15 19:06:55,989 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/b8aa3d81c77328df2b8fc3e16b469e78 2023-07-15 19:06:55,990 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/recovered.edits/9.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec/recovered.edits/9.seqid 2023-07-15 19:06:55,991 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/recovered.edits/13.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df/recovered.edits/13.seqid 2023-07-15 19:06:55,991 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/24151f3340083896622f4b47a76c05ec 2023-07-15 19:06:55,991 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/ea3d8476476263d2ee64f5ca86ee59df 2023-07-15 19:06:55,991 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:55,993 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=134, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:55,995 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testForceSplit from hbase:meta 2023-07-15 19:06:55,997 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testForceSplit' descriptor. 2023-07-15 19:06:55,997 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=134, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:55,998 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testForceSplit' from region states. 2023-07-15 19:06:55,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448015998"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:55,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448015998"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:55,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448015998"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:55,999 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-15 19:06:55,999 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b8aa3d81c77328df2b8fc3e16b469e78, NAME => 'testForceSplit,\x00\x00\x0B\xB8,1689448014667.b8aa3d81c77328df2b8fc3e16b469e78.', STARTKEY => '\x00\x00\x0B\xB8', ENDKEY => ''}, {ENCODED => 24151f3340083896622f4b47a76c05ec, NAME => 'testForceSplit,,1689448013777.24151f3340083896622f4b47a76c05ec.', STARTKEY => '', ENDKEY => ''}, {ENCODED => ea3d8476476263d2ee64f5ca86ee59df, NAME => 'testForceSplit,,1689448014667.ea3d8476476263d2ee64f5ca86ee59df.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'}] 2023-07-15 19:06:55,999 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testForceSplit' as deleted. 2023-07-15 19:06:55,999 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448015999"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:56,000 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testForceSplit state from META 2023-07-15 19:06:56,002 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=134, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:56,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=134, state=SUCCESS; DeleteTableProcedure table=testForceSplit in 31 msec 2023-07-15 19:06:56,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=134 2023-07-15 19:06:56,225 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testForceSplit, procId: 134 completed 2023-07-15 19:06:56,227 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf1 must be between 1K and 16MB. 2023-07-15 19:06:56,227 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] util.TableDescriptorChecker(340): Block size for column family cf2 must be between 1K and 16MB. 2023-07-15 19:06:56,227 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testForceSplit', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, {NAME => 'cf2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:56,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=135, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testForceSplit 2023-07-15 19:06:56,230 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:56,230 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testForceSplit" procId is: 135 2023-07-15 19:06:56,231 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:56,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=135 2023-07-15 19:06:56,232 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,232 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35 empty. 2023-07-15 19:06:56,233 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,233 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:56,243 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:56,244 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => 34767eaa72092f0ccec1aabdce8e6d35, NAME => 'testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testForceSplit', {NAME => 'cf1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, {NAME => 'cf2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '256', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:56,252 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:56,252 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1604): Closing 34767eaa72092f0ccec1aabdce8e6d35, disabling compactions & flushes 2023-07-15 19:06:56,252 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:56,252 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:56,252 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. after waiting 0 ms 2023-07-15 19:06:56,252 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:56,252 INFO [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:56,252 DEBUG [RegionOpenAndInit-testForceSplit-pool-0] regionserver.HRegion(1558): Region close journal for 34767eaa72092f0ccec1aabdce8e6d35: 2023-07-15 19:06:56,254 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:56,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448016254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448016254"}]},"ts":"1689448016254"} 2023-07-15 19:06:56,256 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:06:56,256 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:56,256 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448016256"}]},"ts":"1689448016256"} 2023-07-15 19:06:56,257 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLING in hbase:meta 2023-07-15 19:06:56,260 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:56,261 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:56,261 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:56,261 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:56,261 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:06:56,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=136, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=34767eaa72092f0ccec1aabdce8e6d35, ASSIGN}] 2023-07-15 19:06:56,264 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=136, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=34767eaa72092f0ccec1aabdce8e6d35, ASSIGN 2023-07-15 19:06:56,264 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=136, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=34767eaa72092f0ccec1aabdce8e6d35, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:56,414 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:06:56,416 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=136 updating hbase:meta row=34767eaa72092f0ccec1aabdce8e6d35, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:56,416 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448016416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448016416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448016416"}]},"ts":"1689448016416"} 2023-07-15 19:06:56,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=137, ppid=136, state=RUNNABLE; OpenRegionProcedure 34767eaa72092f0ccec1aabdce8e6d35, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:56,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=135 2023-07-15 19:06:56,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:56,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34767eaa72092f0ccec1aabdce8e6d35, NAME => 'testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:06:56,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:56,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,574 INFO [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,576 DEBUG [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1 2023-07-15 19:06:56,576 DEBUG [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1 2023-07-15 19:06:56,576 INFO [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34767eaa72092f0ccec1aabdce8e6d35 columnFamilyName cf1 2023-07-15 19:06:56,577 INFO [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] regionserver.HStore(310): Store=34767eaa72092f0ccec1aabdce8e6d35/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:56,577 INFO [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,578 DEBUG [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2 2023-07-15 19:06:56,578 DEBUG [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2 2023-07-15 19:06:56,578 INFO [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34767eaa72092f0ccec1aabdce8e6d35 columnFamilyName cf2 2023-07-15 19:06:56,579 INFO [StoreOpener-34767eaa72092f0ccec1aabdce8e6d35-1] regionserver.HStore(310): Store=34767eaa72092f0ccec1aabdce8e6d35/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:56,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:56,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:56,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:56,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 34767eaa72092f0ccec1aabdce8e6d35; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71425936, jitterRate=0.06432938575744629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:56,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 34767eaa72092f0ccec1aabdce8e6d35: 2023-07-15 19:06:56,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35., pid=137, masterSystemTime=1689448016569 2023-07-15 19:06:56,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:56,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:56,587 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=136 updating hbase:meta row=34767eaa72092f0ccec1aabdce8e6d35, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:56,588 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448016587"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448016587"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448016587"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448016587"}]},"ts":"1689448016587"} 2023-07-15 19:06:56,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=137, resume processing ppid=136 2023-07-15 19:06:56,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=137, ppid=136, state=SUCCESS; OpenRegionProcedure 34767eaa72092f0ccec1aabdce8e6d35, server=jenkins-hbase4.apache.org,36223,1689447992001 in 171 msec 2023-07-15 19:06:56,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=136, resume processing ppid=135 2023-07-15 19:06:56,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=136, ppid=135, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=34767eaa72092f0ccec1aabdce8e6d35, ASSIGN in 328 msec 2023-07-15 19:06:56,592 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:56,592 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448016592"}]},"ts":"1689448016592"} 2023-07-15 19:06:56,593 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=ENABLED in hbase:meta 2023-07-15 19:06:56,595 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testForceSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:56,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=135, state=SUCCESS; CreateTableProcedure table=testForceSplit in 368 msec 2023-07-15 19:06:56,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=135 2023-07-15 19:06:56,983 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testForceSplit, procId: 135 completed 2023-07-15 19:06:56,984 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testForceSplit get assigned. Timeout = 60000ms 2023-07-15 19:06:56,984 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:56,986 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testForceSplit assigned to meta. Checking AM states. 2023-07-15 19:06:56,986 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:06:56,986 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testForceSplit assigned. 2023-07-15 19:06:57,011 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6000 Client: jenkins//172.31.14.131 first region in multi=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:57,036 INFO [Listener at localhost/45529] client.TestAdmin1(291): Initial regions (1): [region=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=2] 2023-07-15 19:06:57,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:57,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:57,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:57,052 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:57,052 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(206): testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:57,054 INFO [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.HRegion(2745): Flushing 34767eaa72092f0ccec1aabdce8e6d35 2/2 column families, dataSize=190.72 KB heapSize=640.34 KB 2023-07-15 19:06:57,066 INFO [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=9.08 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/.tmp/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c 2023-07-15 19:06:57,093 INFO [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=181.64 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/.tmp/cf2/841ffd1aa6fe423d84cf694a15fe2a58 2023-07-15 19:06:57,099 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/.tmp/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c 2023-07-15 19:06:57,104 INFO [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c, entries=300, sequenceid=6, filesize=17.0 K 2023-07-15 19:06:57,106 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/.tmp/cf2/841ffd1aa6fe423d84cf694a15fe2a58 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58 2023-07-15 19:06:57,111 INFO [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58, entries=6000, sequenceid=6, filesize=248.5 K 2023-07-15 19:06:57,111 INFO [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.HRegion(2948): Finished flush of dataSize ~190.72 KB/195300, heapSize ~640.31 KB/655680, currentSize=0 B/0 for 34767eaa72092f0ccec1aabdce8e6d35 in 57ms, sequenceid=6, compaction requested=false 2023-07-15 19:06:57,112 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=23,queue=1,port=36223] regionserver.HRegion(2446): Flush status journal for 34767eaa72092f0ccec1aabdce8e6d35: 2023-07-15 19:06:57,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:57,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=138, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=34767eaa72092f0ccec1aabdce8e6d35, daughterA=5c7176f4f0ad49a9596b1fd8b4059ad6, daughterB=cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,114 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=138, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=34767eaa72092f0ccec1aabdce8e6d35, daughterA=5c7176f4f0ad49a9596b1fd8b4059ad6, daughterB=cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,114 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=138, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=34767eaa72092f0ccec1aabdce8e6d35, daughterA=5c7176f4f0ad49a9596b1fd8b4059ad6, daughterB=cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,114 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=138, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testForceSplit, parent=34767eaa72092f0ccec1aabdce8e6d35, daughterA=5c7176f4f0ad49a9596b1fd8b4059ad6, daughterB=cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=139, ppid=138, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=34767eaa72092f0ccec1aabdce8e6d35, UNASSIGN}] 2023-07-15 19:06:57,117 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=139, ppid=138, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=34767eaa72092f0ccec1aabdce8e6d35, UNASSIGN 2023-07-15 19:06:57,118 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=139 updating hbase:meta row=34767eaa72092f0ccec1aabdce8e6d35, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:57,118 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448017118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448017118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448017118"}]},"ts":"1689448017118"} 2023-07-15 19:06:57,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=140, ppid=139, state=RUNNABLE; CloseRegionProcedure 34767eaa72092f0ccec1aabdce8e6d35, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:57,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 34767eaa72092f0ccec1aabdce8e6d35, disabling compactions & flushes 2023-07-15 19:06:57,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. after waiting 0 ms 2023-07-15 19:06:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:57,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 19:06:57,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:57,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 34767eaa72092f0ccec1aabdce8e6d35: 2023-07-15 19:06:57,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:57,277 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=139 updating hbase:meta row=34767eaa72092f0ccec1aabdce8e6d35, regionState=CLOSED 2023-07-15 19:06:57,278 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448017277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448017277"}]},"ts":"1689448017277"} 2023-07-15 19:06:57,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=140, resume processing ppid=139 2023-07-15 19:06:57,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=140, ppid=139, state=SUCCESS; CloseRegionProcedure 34767eaa72092f0ccec1aabdce8e6d35, server=jenkins-hbase4.apache.org,36223,1689447992001 in 160 msec 2023-07-15 19:06:57,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=139, resume processing ppid=138 2023-07-15 19:06:57,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=139, ppid=138, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=34767eaa72092f0ccec1aabdce8e6d35, UNASSIGN in 164 msec 2023-07-15 19:06:57,289 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=138 splitting 2 storefiles, region=34767eaa72092f0ccec1aabdce8e6d35, threads=2 2023-07-15 19:06:57,289 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=138 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58 for region: 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:57,289 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=138 splitting started for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c for region: 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:57,293 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(713): Will create HFileLink file for hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c, top=false 2023-07-15 19:06:57,297 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/.splits/5c7176f4f0ad49a9596b1fd8b4059ad6/cf1/testForceSplit=34767eaa72092f0ccec1aabdce8e6d35-557e1a7a24864db7b89c1eb2e3e0fe9c for child: 5c7176f4f0ad49a9596b1fd8b4059ad6, parent: 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:57,301 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=138 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c for region: 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:57,314 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=138 splitting complete for store file: hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58 for region: 34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:57,314 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=138 split storefiles for region 34767eaa72092f0ccec1aabdce8e6d35 Daughter A: 2 storefiles, Daughter B: 1 storefiles. 2023-07-15 19:06:57,343 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=-1 2023-07-15 19:06:57,345 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=-1 2023-07-15 19:06:57,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448017346"},{"qualifier":"splitA","vlen":52,"tag":[],"timestamp":"1689448017346"},{"qualifier":"splitB","vlen":52,"tag":[],"timestamp":"1689448017346"}]},"ts":"1689448017346"} 2023-07-15 19:06:57,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448017346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448017346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448017346"}]},"ts":"1689448017346"} 2023-07-15 19:06:57,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448017346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448017346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448017346"}]},"ts":"1689448017346"} 2023-07-15 19:06:57,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=141, ppid=138, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=5c7176f4f0ad49a9596b1fd8b4059ad6, ASSIGN}, {pid=142, ppid=138, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=cd2920ddaf878e04085ff4aa13d5c424, ASSIGN}] 2023-07-15 19:06:57,350 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=142, ppid=138, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=cd2920ddaf878e04085ff4aa13d5c424, ASSIGN 2023-07-15 19:06:57,350 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=141, ppid=138, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testForceSplit, region=5c7176f4f0ad49a9596b1fd8b4059ad6, ASSIGN 2023-07-15 19:06:57,350 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=142, ppid=138, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=cd2920ddaf878e04085ff4aa13d5c424, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:57,350 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=141, ppid=138, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testForceSplit, region=5c7176f4f0ad49a9596b1fd8b4059ad6, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:57,500 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 19:06:57,502 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=142 updating hbase:meta row=cd2920ddaf878e04085ff4aa13d5c424, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:57,502 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=141 updating hbase:meta row=5c7176f4f0ad49a9596b1fd8b4059ad6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:57,503 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448017502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448017502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448017502"}]},"ts":"1689448017502"} 2023-07-15 19:06:57,503 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448017502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448017502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448017502"}]},"ts":"1689448017502"} 2023-07-15 19:06:57,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=143, ppid=142, state=RUNNABLE; OpenRegionProcedure cd2920ddaf878e04085ff4aa13d5c424, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:57,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=144, ppid=141, state=RUNNABLE; OpenRegionProcedure 5c7176f4f0ad49a9596b1fd8b4059ad6, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:57,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:57,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cd2920ddaf878e04085ff4aa13d5c424, NAME => 'testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.', STARTKEY => '\x00\x00\x0B\xB8', ENDKEY => ''} 2023-07-15 19:06:57,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:57,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,660 INFO [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,661 DEBUG [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf1 2023-07-15 19:06:57,661 DEBUG [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf1 2023-07-15 19:06:57,662 INFO [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd2920ddaf878e04085ff4aa13d5c424 columnFamilyName cf1 2023-07-15 19:06:57,662 INFO [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] regionserver.HStore(310): Store=cd2920ddaf878e04085ff4aa13d5c424/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:57,662 INFO [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,663 DEBUG [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2 2023-07-15 19:06:57,663 DEBUG [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2 2023-07-15 19:06:57,664 INFO [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd2920ddaf878e04085ff4aa13d5c424 columnFamilyName cf2 2023-07-15 19:06:57,671 DEBUG [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58-top 2023-07-15 19:06:57,671 INFO [StoreOpener-cd2920ddaf878e04085ff4aa13d5c424-1] regionserver.HStore(310): Store=cd2920ddaf878e04085ff4aa13d5c424/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:57,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:57,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:57,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cd2920ddaf878e04085ff4aa13d5c424; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62476871, jitterRate=-0.06902207434177399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:57,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cd2920ddaf878e04085ff4aa13d5c424: 2023-07-15 19:06:57,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424., pid=143, masterSystemTime=1689448017655 2023-07-15 19:06:57,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:57,678 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:57,679 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf2 since it belongs to recently split daughter region testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:57,679 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1912): cd2920ddaf878e04085ff4aa13d5c424/cf2 is initiating minor compaction (all files) 2023-07-15 19:06:57,679 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cd2920ddaf878e04085ff4aa13d5c424/cf2 in testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:57,679 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58-top] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/.tmp, totalSize=248.5 K 2023-07-15 19:06:57,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:57,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:57,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:57,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5c7176f4f0ad49a9596b1fd8b4059ad6, NAME => 'testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'} 2023-07-15 19:06:57,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=142 updating hbase:meta row=cd2920ddaf878e04085ff4aa13d5c424, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:57,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testForceSplit 5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:57,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448017680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448017680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448017680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448017680"}]},"ts":"1689448017680"} 2023-07-15 19:06:57,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:57,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:57,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:57,681 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] compactions.Compactor(207): Compacting 841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35, keycount=3000, bloomtype=ROW, size=248.5 K, encoding=NONE, compression=NONE, seqNum=7, earliestPutTs=1689448017019 2023-07-15 19:06:57,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=143, resume processing ppid=142 2023-07-15 19:06:57,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=143, ppid=142, state=SUCCESS; OpenRegionProcedure cd2920ddaf878e04085ff4aa13d5c424, server=jenkins-hbase4.apache.org,36223,1689447992001 in 177 msec 2023-07-15 19:06:57,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=142, ppid=138, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=cd2920ddaf878e04085ff4aa13d5c424, ASSIGN in 334 msec 2023-07-15 19:06:57,686 INFO [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region 5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:57,687 DEBUG [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf1 2023-07-15 19:06:57,687 DEBUG [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf1 2023-07-15 19:06:57,687 INFO [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c7176f4f0ad49a9596b1fd8b4059ad6 columnFamilyName cf1 2023-07-15 19:06:57,693 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] throttle.PressureAwareThroughputController(145): cd2920ddaf878e04085ff4aa13d5c424#cf2#compaction#29 average throughput is 12.67 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:57,695 DEBUG [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf1/testForceSplit=34767eaa72092f0ccec1aabdce8e6d35-557e1a7a24864db7b89c1eb2e3e0fe9c 2023-07-15 19:06:57,695 INFO [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] regionserver.HStore(310): Store=5c7176f4f0ad49a9596b1fd8b4059ad6/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:57,695 INFO [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf2 of region 5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:57,696 DEBUG [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2 2023-07-15 19:06:57,696 DEBUG [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2 2023-07-15 19:06:57,697 INFO [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c7176f4f0ad49a9596b1fd8b4059ad6 columnFamilyName cf2 2023-07-15 19:06:57,709 DEBUG [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] regionserver.HStore(539): loaded hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58-bottom 2023-07-15 19:06:57,709 INFO [StoreOpener-5c7176f4f0ad49a9596b1fd8b4059ad6-1] regionserver.HStore(310): Store=5c7176f4f0ad49a9596b1fd8b4059ad6/cf2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:57,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:57,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:57,711 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/.tmp/cf2/2b2355dd93d24d36882b3303bff94f5c as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2/2b2355dd93d24d36882b3303bff94f5c 2023-07-15 19:06:57,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testForceSplit descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:06:57,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:57,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5c7176f4f0ad49a9596b1fd8b4059ad6; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64285684, jitterRate=-0.042068660259246826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:06:57,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5c7176f4f0ad49a9596b1fd8b4059ad6: 2023-07-15 19:06:57,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6., pid=144, masterSystemTime=1689448017655 2023-07-15 19:06:57,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-15 19:06:57,718 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-15 19:06:57,718 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in cd2920ddaf878e04085ff4aa13d5c424/cf2 of cd2920ddaf878e04085ff4aa13d5c424 into 2b2355dd93d24d36882b3303bff94f5c(size=126.6 K), total size for store is 126.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:57,718 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cd2920ddaf878e04085ff4aa13d5c424: 2023-07-15 19:06:57,718 INFO [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424., storeName=cd2920ddaf878e04085ff4aa13d5c424/cf2, priority=15, startTime=1689448017677; duration=0sec 2023-07-15 19:06:57,719 DEBUG [RS:1;jenkins-hbase4:36223-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:57,719 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf2 since it belongs to recently split daughter region testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:57,719 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1912): 5c7176f4f0ad49a9596b1fd8b4059ad6/cf2 is initiating minor compaction (all files) 2023-07-15 19:06:57,719 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 5c7176f4f0ad49a9596b1fd8b4059ad6/cf2 in testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:57,719 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58-bottom] into tmpdir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/.tmp, totalSize=248.5 K 2023-07-15 19:06:57,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:57,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:57,720 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] compactions.Compactor(207): Compacting 841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35, keycount=3000, bloomtype=ROW, size=248.5 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689448017019 2023-07-15 19:06:57,720 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=141 updating hbase:meta row=5c7176f4f0ad49a9596b1fd8b4059ad6, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:57,720 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448017720"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448017720"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448017720"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448017720"}]},"ts":"1689448017720"} 2023-07-15 19:06:57,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=144, resume processing ppid=141 2023-07-15 19:06:57,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=144, ppid=141, state=SUCCESS; OpenRegionProcedure 5c7176f4f0ad49a9596b1fd8b4059ad6, server=jenkins-hbase4.apache.org,36223,1689447992001 in 217 msec 2023-07-15 19:06:57,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=141, resume processing ppid=138 2023-07-15 19:06:57,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=141, ppid=138, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=5c7176f4f0ad49a9596b1fd8b4059ad6, ASSIGN in 375 msec 2023-07-15 19:06:57,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=138, state=SUCCESS; SplitTableRegionProcedure table=testForceSplit, parent=34767eaa72092f0ccec1aabdce8e6d35, daughterA=5c7176f4f0ad49a9596b1fd8b4059ad6, daughterB=cd2920ddaf878e04085ff4aa13d5c424 in 614 msec 2023-07-15 19:06:57,733 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] throttle.PressureAwareThroughputController(145): 5c7176f4f0ad49a9596b1fd8b4059ad6#cf2#compaction#30 average throughput is 11.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-15 19:06:57,748 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/.tmp/cf2/77b5091e3267443d97c064e133b82e19 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2/77b5091e3267443d97c064e133b82e19 2023-07-15 19:06:57,753 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 5c7176f4f0ad49a9596b1fd8b4059ad6/cf2 of 5c7176f4f0ad49a9596b1fd8b4059ad6 into 77b5091e3267443d97c064e133b82e19(size=126.6 K), total size for store is 126.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-15 19:06:57,753 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5c7176f4f0ad49a9596b1fd8b4059ad6: 2023-07-15 19:06:57,753 INFO [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6., storeName=5c7176f4f0ad49a9596b1fd8b4059ad6/cf2, priority=15, startTime=1689448017717; duration=0sec 2023-07-15 19:06:57,753 DEBUG [RS:1;jenkins-hbase4:36223-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-15 19:06:58,118 INFO [CheckForSplit] client.TestAdmin1$1(333): Found: [region=testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=10, region=testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424., hostname=jenkins-hbase4.apache.org,36223,1689447992001, seqNum=10] 2023-07-15 19:06:58,118 DEBUG [CheckForSplit] client.TestAdmin1$1(338): CheckForSplit thread exited, current region count: 2 2023-07-15 19:06:58,119 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.RSRpcServices(3109): Region has changed on the scanner -6449571020524224497: regionName=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35., scannerRegionName=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35., closing... 2023-07-15 19:06:58,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] ipc.CallRunner(144): callId: 450 service: ClientService methodName: Scan size: 48 connection: 172.31.14.131:53184 deadline: 1689448078119, exception=org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224497: regionName=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35., scannerRegionName=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. 2023-07-15 19:06:58,120 DEBUG [Listener at localhost/45529] client.ScannerCallableWithReplicas(204): Scan with primary region returns org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause org.apache.hadoop.hbase.DoNotRetryIOException: Resetting the scanner -- see exception cause at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:228) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:258) at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:58) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:124) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:187) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:393) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:367) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:74) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224497: regionName=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35., scannerRegionName=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.ScannerCallable.next(ScannerCallable.java:194) ... 11 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region has changed on the scanner -6449571020524224497: regionName=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35., scannerRegionName=testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35. at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionScanner(RSRpcServices.java:3122) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3528) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44996) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-15 19:06:58,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf1 2023-07-15 19:06:58,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:58,140 DEBUG [Listener at localhost/45529] client.ClientScanner(240): Advancing internal scanner to startKey at '\x00\x00\x0B\xB8', inclusive 2023-07-15 19:06:58,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=36223] regionserver.StoreScanner(1093): Switch to stream read (scanned=1050 bytes) of cf2 2023-07-15 19:06:58,154 DEBUG [Listener at localhost/45529] client.TestAdmin1(373): SplitKey=3000&deltaForLargestFamily=0, r={ENCODED => 5c7176f4f0ad49a9596b1fd8b4059ad6, NAME => 'testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'} 2023-07-15 19:06:58,155 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testForceSplit 2023-07-15 19:06:58,155 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testForceSplit 2023-07-15 19:06:58,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=145, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testForceSplit 2023-07-15 19:06:58,159 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448018159"}]},"ts":"1689448018159"} 2023-07-15 19:06:58,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=145 2023-07-15 19:06:58,160 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLING in hbase:meta 2023-07-15 19:06:58,162 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testForceSplit to state=DISABLING 2023-07-15 19:06:58,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=146, ppid=145, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=cd2920ddaf878e04085ff4aa13d5c424, UNASSIGN}, {pid=147, ppid=145, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=5c7176f4f0ad49a9596b1fd8b4059ad6, UNASSIGN}] 2023-07-15 19:06:58,165 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=146, ppid=145, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=cd2920ddaf878e04085ff4aa13d5c424, UNASSIGN 2023-07-15 19:06:58,165 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=147, ppid=145, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testForceSplit, region=5c7176f4f0ad49a9596b1fd8b4059ad6, UNASSIGN 2023-07-15 19:06:58,166 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=146 updating hbase:meta row=cd2920ddaf878e04085ff4aa13d5c424, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:58,166 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=147 updating hbase:meta row=5c7176f4f0ad49a9596b1fd8b4059ad6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:58,166 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448018165"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448018165"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448018165"}]},"ts":"1689448018165"} 2023-07-15 19:06:58,166 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448018166"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448018166"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448018166"}]},"ts":"1689448018166"} 2023-07-15 19:06:58,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=148, ppid=146, state=RUNNABLE; CloseRegionProcedure cd2920ddaf878e04085ff4aa13d5c424, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:58,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=149, ppid=147, state=RUNNABLE; CloseRegionProcedure 5c7176f4f0ad49a9596b1fd8b4059ad6, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:58,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:58,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5c7176f4f0ad49a9596b1fd8b4059ad6, disabling compactions & flushes 2023-07-15 19:06:58,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:58,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:58,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. after waiting 0 ms 2023-07-15 19:06:58,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:58,320 DEBUG [StoreCloser-testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58-bottom] to archive 2023-07-15 19:06:58,321 DEBUG [StoreCloser-testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:58,323 DEBUG [StoreCloser-testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:58,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=9 2023-07-15 19:06:58,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6. 2023-07-15 19:06:58,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5c7176f4f0ad49a9596b1fd8b4059ad6: 2023-07-15 19:06:58,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:58,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:58,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cd2920ddaf878e04085ff4aa13d5c424, disabling compactions & flushes 2023-07-15 19:06:58,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:58,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:58,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. after waiting 0 ms 2023-07-15 19:06:58,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:58,329 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=147 updating hbase:meta row=5c7176f4f0ad49a9596b1fd8b4059ad6, regionState=CLOSED 2023-07-15 19:06:58,330 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448018329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448018329"}]},"ts":"1689448018329"} 2023-07-15 19:06:58,330 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35->hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58-top] to archive 2023-07-15 19:06:58,331 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-15 19:06:58,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=149, resume processing ppid=147 2023-07-15 19:06:58,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=149, ppid=147, state=SUCCESS; CloseRegionProcedure 5c7176f4f0ad49a9596b1fd8b4059ad6, server=jenkins-hbase4.apache.org,36223,1689447992001 in 164 msec 2023-07-15 19:06:58,333 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=147, ppid=145, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=5c7176f4f0ad49a9596b1fd8b4059ad6, UNASSIGN in 169 msec 2023-07-15 19:06:58,333 DEBUG [StoreCloser-testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2/841ffd1aa6fe423d84cf694a15fe2a58.34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:58,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=9 2023-07-15 19:06:58,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424. 2023-07-15 19:06:58,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cd2920ddaf878e04085ff4aa13d5c424: 2023-07-15 19:06:58,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:58,339 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=146 updating hbase:meta row=cd2920ddaf878e04085ff4aa13d5c424, regionState=CLOSED 2023-07-15 19:06:58,339 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448018338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448018338"}]},"ts":"1689448018338"} 2023-07-15 19:06:58,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=148, resume processing ppid=146 2023-07-15 19:06:58,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=148, ppid=146, state=SUCCESS; CloseRegionProcedure cd2920ddaf878e04085ff4aa13d5c424, server=jenkins-hbase4.apache.org,36223,1689447992001 in 173 msec 2023-07-15 19:06:58,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=146, resume processing ppid=145 2023-07-15 19:06:58,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=146, ppid=145, state=SUCCESS; TransitRegionStateProcedure table=testForceSplit, region=cd2920ddaf878e04085ff4aa13d5c424, UNASSIGN in 178 msec 2023-07-15 19:06:58,342 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448018342"}]},"ts":"1689448018342"} 2023-07-15 19:06:58,343 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testForceSplit, state=DISABLED in hbase:meta 2023-07-15 19:06:58,345 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testForceSplit to state=DISABLED 2023-07-15 19:06:58,346 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=145, state=SUCCESS; DisableTableProcedure table=testForceSplit in 190 msec 2023-07-15 19:06:58,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=145 2023-07-15 19:06:58,410 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testForceSplit, procId: 145 completed 2023-07-15 19:06:58,411 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testForceSplit 2023-07-15 19:06:58,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=150, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:58,413 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=150, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:58,414 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=150, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:58,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=150 2023-07-15 19:06:58,419 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:58,419 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:58,419 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:58,421 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/recovered.edits] 2023-07-15 19:06:58,421 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/recovered.edits] 2023-07-15 19:06:58,421 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/recovered.edits] 2023-07-15 19:06:58,424 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf1/557e1a7a24864db7b89c1eb2e3e0fe9c 2023-07-15 19:06:58,424 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf1/testForceSplit=34767eaa72092f0ccec1aabdce8e6d35-557e1a7a24864db7b89c1eb2e3e0fe9c to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf1/testForceSplit=34767eaa72092f0ccec1aabdce8e6d35-557e1a7a24864db7b89c1eb2e3e0fe9c 2023-07-15 19:06:58,425 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2/2b2355dd93d24d36882b3303bff94f5c to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/cf2/2b2355dd93d24d36882b3303bff94f5c 2023-07-15 19:06:58,427 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2/77b5091e3267443d97c064e133b82e19 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/cf2/77b5091e3267443d97c064e133b82e19 2023-07-15 19:06:58,428 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/cf2/841ffd1aa6fe423d84cf694a15fe2a58 2023-07-15 19:06:58,428 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/recovered.edits/13.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424/recovered.edits/13.seqid 2023-07-15 19:06:58,429 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/cd2920ddaf878e04085ff4aa13d5c424 2023-07-15 19:06:58,431 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/recovered.edits/13.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6/recovered.edits/13.seqid 2023-07-15 19:06:58,431 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/recovered.edits/9.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35/recovered.edits/9.seqid 2023-07-15 19:06:58,431 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/5c7176f4f0ad49a9596b1fd8b4059ad6 2023-07-15 19:06:58,431 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testForceSplit/34767eaa72092f0ccec1aabdce8e6d35 2023-07-15 19:06:58,431 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testForceSplit regions 2023-07-15 19:06:58,433 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=150, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:58,436 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testForceSplit from hbase:meta 2023-07-15 19:06:58,437 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testForceSplit' descriptor. 2023-07-15 19:06:58,438 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=150, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:58,438 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testForceSplit' from region states. 2023-07-15 19:06:58,438 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,\\x00\\x00\\x0B\\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448018438"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:58,438 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448018438"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:58,438 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448018438"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:58,439 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-15 19:06:58,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cd2920ddaf878e04085ff4aa13d5c424, NAME => 'testForceSplit,\x00\x00\x0B\xB8,1689448017112.cd2920ddaf878e04085ff4aa13d5c424.', STARTKEY => '\x00\x00\x0B\xB8', ENDKEY => ''}, {ENCODED => 34767eaa72092f0ccec1aabdce8e6d35, NAME => 'testForceSplit,,1689448016227.34767eaa72092f0ccec1aabdce8e6d35.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 5c7176f4f0ad49a9596b1fd8b4059ad6, NAME => 'testForceSplit,,1689448017112.5c7176f4f0ad49a9596b1fd8b4059ad6.', STARTKEY => '', ENDKEY => '\x00\x00\x0B\xB8'}] 2023-07-15 19:06:58,440 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testForceSplit' as deleted. 2023-07-15 19:06:58,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testForceSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448018440"}]},"ts":"9223372036854775807"} 2023-07-15 19:06:58,441 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testForceSplit state from META 2023-07-15 19:06:58,442 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=150, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testForceSplit 2023-07-15 19:06:58,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=150, state=SUCCESS; DeleteTableProcedure table=testForceSplit in 31 msec 2023-07-15 19:06:58,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=150 2023-07-15 19:06:58,665 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testForceSplit, procId: 150 completed 2023-07-15 19:06:58,684 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testForceSplitMultiFamily Thread=625 (was 620) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:36362 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:52784 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_5310775_17 at /127.0.0.1:38400 [Waiting for operation #30] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:36254 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-metaLookup-shared--pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:33602 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:44880 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-metaLookup-shared--pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d866e3-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:42084 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:2;jenkins-hbase4:42217-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:36332 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-362724512_17 at /127.0.0.1:36066 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2d246b2-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=740 (was 740), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 263), ProcessCount=170 (was 170), AvailableMemoryMB=5262 (was 5342) 2023-07-15 19:06:58,685 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=625 is superior to 500 2023-07-15 19:06:58,701 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testSplitAndMergeWithReplicaTable Thread=625, OpenFileDescriptor=740, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=170, AvailableMemoryMB=5261 2023-07-15 19:06:58,701 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=625 is superior to 500 2023-07-15 19:06:58,702 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testSplitAndMergeWithReplicaTable', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '3'}}, {NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 19:06:58,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=151, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSplitAndMergeWithReplicaTable 2023-07-15 19:06:58,705 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=151, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testSplitAndMergeWithReplicaTable execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:06:58,705 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testSplitAndMergeWithReplicaTable" procId is: 151 2023-07-15 19:06:58,705 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=151, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testSplitAndMergeWithReplicaTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:06:58,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=151 2023-07-15 19:06:58,708 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:58,708 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:58,708 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:58,708 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3 empty. 2023-07-15 19:06:58,709 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26 empty. 2023-07-15 19:06:58,709 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8 empty. 2023-07-15 19:06:58,709 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:58,709 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:58,709 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:58,709 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testSplitAndMergeWithReplicaTable regions 2023-07-15 19:06:58,719 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/.tabledesc/.tableinfo.0000000001 2023-07-15 19:06:58,720 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(7675): creating {ENCODED => 7e496e21c7d001317d5cf585a8130f26, NAME => 'testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.', STARTKEY => '7', ENDKEY => ''}, tableDescriptor='testSplitAndMergeWithReplicaTable', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '3'}}, {NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:58,721 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 577e272d9eea3fb0c7b6721baf1c28f8, NAME => 'testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.', STARTKEY => '4', ENDKEY => '7'}, tableDescriptor='testSplitAndMergeWithReplicaTable', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '3'}}, {NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:58,721 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 71ec91d4744bf2d970141091f4a1cca3, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.', STARTKEY => '', ENDKEY => '4'}, tableDescriptor='testSplitAndMergeWithReplicaTable', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '3'}}, {NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:06:58,751 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:58,751 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(1604): Closing 577e272d9eea3fb0c7b6721baf1c28f8, disabling compactions & flushes 2023-07-15 19:06:58,751 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:06:58,751 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:06:58,751 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. after waiting 0 ms 2023-07-15 19:06:58,751 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:06:58,751 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:58,751 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(1604): Closing 7e496e21c7d001317d5cf585a8130f26, disabling compactions & flushes 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-1] regionserver.HRegion(1558): Region close journal for 577e272d9eea3fb0c7b6721baf1c28f8: 2023-07-15 19:06:58,752 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. after waiting 0 ms 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:06:58,752 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-2] regionserver.HRegion(1558): Region close journal for 7e496e21c7d001317d5cf585a8130f26: 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(1604): Closing 71ec91d4744bf2d970141091f4a1cca3, disabling compactions & flushes 2023-07-15 19:06:58,752 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. after waiting 0 ms 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:06:58,752 INFO [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:06:58,752 DEBUG [RegionOpenAndInit-testSplitAndMergeWithReplicaTable-pool-0] regionserver.HRegion(1558): Region close journal for 71ec91d4744bf2d970141091f4a1cca3: 2023-07-15 19:06:58,754 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=151, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testSplitAndMergeWithReplicaTable execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:06:58,756 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":8,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448018755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448018755"},{"qualifier":"server_0001","vlen":0,"tag":[],"timestamp":"1689448018755"},{"qualifier":"serverstartcode_0001","vlen":0,"tag":[],"timestamp":"1689448018755"}]},"ts":"1689448018755"} 2023-07-15 19:06:58,756 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":8,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448018755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448018755"},{"qualifier":"server_0001","vlen":0,"tag":[],"timestamp":"1689448018755"},{"qualifier":"serverstartcode_0001","vlen":0,"tag":[],"timestamp":"1689448018755"}]},"ts":"1689448018755"} 2023-07-15 19:06:58,756 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":8,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448018755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448018755"},{"qualifier":"server_0001","vlen":0,"tag":[],"timestamp":"1689448018755"},{"qualifier":"serverstartcode_0001","vlen":0,"tag":[],"timestamp":"1689448018755"}]},"ts":"1689448018755"} 2023-07-15 19:06:58,757 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-15 19:06:58,758 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=151, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testSplitAndMergeWithReplicaTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:06:58,758 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448018758"}]},"ts":"1689448018758"} 2023-07-15 19:06:58,759 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testSplitAndMergeWithReplicaTable, state=ENABLING in hbase:meta 2023-07-15 19:06:58,763 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:06:58,767 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:06:58,768 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:06:58,768 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:06:58,768 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=3, number of hosts=1, number of racks=1 2023-07-15 19:06:58,768 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=152, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=71ec91d4744bf2d970141091f4a1cca3, ASSIGN}, {pid=153, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=444ed713f9dba45050a25f589f763038, ASSIGN}, {pid=154, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=9b2377074d2f148303e8254e6335df64, ASSIGN}, {pid=155, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=577e272d9eea3fb0c7b6721baf1c28f8, ASSIGN}, {pid=156, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7ac5281096e622acd7d0636cab3f2580, ASSIGN}, {pid=157, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=92b70f6d151941fd1db7b5555e62dbff, ASSIGN}, {pid=158, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7e496e21c7d001317d5cf585a8130f26, ASSIGN}, {pid=159, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=4814b2c3e764165368b352d42887446c, ASSIGN}, {pid=160, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=3b01706d08a57198ac1f922201f72811, ASSIGN}] 2023-07-15 19:06:58,771 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=153, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=444ed713f9dba45050a25f589f763038, ASSIGN 2023-07-15 19:06:58,771 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=152, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=71ec91d4744bf2d970141091f4a1cca3, ASSIGN 2023-07-15 19:06:58,771 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=154, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=9b2377074d2f148303e8254e6335df64, ASSIGN 2023-07-15 19:06:58,771 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=155, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=577e272d9eea3fb0c7b6721baf1c28f8, ASSIGN 2023-07-15 19:06:58,771 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=153, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=444ed713f9dba45050a25f589f763038, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:58,771 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=152, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=71ec91d4744bf2d970141091f4a1cca3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:06:58,772 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=155, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=577e272d9eea3fb0c7b6721baf1c28f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:58,772 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=154, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=9b2377074d2f148303e8254e6335df64, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:58,772 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=160, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=3b01706d08a57198ac1f922201f72811, ASSIGN 2023-07-15 19:06:58,772 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=159, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=4814b2c3e764165368b352d42887446c, ASSIGN 2023-07-15 19:06:58,772 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=158, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7e496e21c7d001317d5cf585a8130f26, ASSIGN 2023-07-15 19:06:58,772 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=157, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=92b70f6d151941fd1db7b5555e62dbff, ASSIGN 2023-07-15 19:06:58,772 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=156, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7ac5281096e622acd7d0636cab3f2580, ASSIGN 2023-07-15 19:06:58,773 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=160, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=3b01706d08a57198ac1f922201f72811, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:06:58,773 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=158, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7e496e21c7d001317d5cf585a8130f26, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:58,773 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=159, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=4814b2c3e764165368b352d42887446c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:06:58,773 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=157, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=92b70f6d151941fd1db7b5555e62dbff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:06:58,773 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=156, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7ac5281096e622acd7d0636cab3f2580, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:06:58,922 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 9 regions. 9 retained the pre-restart assignment. 2023-07-15 19:06:58,927 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=152 updating hbase:meta row=71ec91d4744bf2d970141091f4a1cca3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:58,927 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=155 updating hbase:meta row=577e272d9eea3fb0c7b6721baf1c28f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:58,927 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=160 updating hbase:meta row=3b01706d08a57198ac1f922201f72811, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:58,927 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448018927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448018927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448018927"}]},"ts":"1689448018927"} 2023-07-15 19:06:58,928 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448018927"},{"qualifier":"sn_0002","vlen":45,"tag":[],"timestamp":"1689448018927"},{"qualifier":"state_0002","vlen":7,"tag":[],"timestamp":"1689448018927"}]},"ts":"1689448018927"} 2023-07-15 19:06:58,927 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=154 updating hbase:meta row=9b2377074d2f148303e8254e6335df64, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:58,927 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=156 updating hbase:meta row=7ac5281096e622acd7d0636cab3f2580, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:58,928 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448018927"},{"qualifier":"sn_0002","vlen":45,"tag":[],"timestamp":"1689448018927"},{"qualifier":"state_0002","vlen":7,"tag":[],"timestamp":"1689448018927"}]},"ts":"1689448018927"} 2023-07-15 19:06:58,928 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448018927"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689448018927"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689448018927"}]},"ts":"1689448018927"} 2023-07-15 19:06:58,927 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448018927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448018927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448018927"}]},"ts":"1689448018927"} 2023-07-15 19:06:58,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=161, ppid=152, state=RUNNABLE; OpenRegionProcedure 71ec91d4744bf2d970141091f4a1cca3, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:58,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=162, ppid=160, state=RUNNABLE; OpenRegionProcedure 3b01706d08a57198ac1f922201f72811, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:58,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=163, ppid=154, state=RUNNABLE; OpenRegionProcedure 9b2377074d2f148303e8254e6335df64, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:58,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=164, ppid=156, state=RUNNABLE; OpenRegionProcedure 7ac5281096e622acd7d0636cab3f2580, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:06:58,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=165, ppid=155, state=RUNNABLE; OpenRegionProcedure 577e272d9eea3fb0c7b6721baf1c28f8, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:58,932 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=159 updating hbase:meta row=4814b2c3e764165368b352d42887446c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:58,932 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448018932"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689448018932"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689448018932"}]},"ts":"1689448018932"} 2023-07-15 19:06:58,932 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=157 updating hbase:meta row=92b70f6d151941fd1db7b5555e62dbff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:58,932 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448018932"},{"qualifier":"sn_0002","vlen":45,"tag":[],"timestamp":"1689448018932"},{"qualifier":"state_0002","vlen":7,"tag":[],"timestamp":"1689448018932"}]},"ts":"1689448018932"} 2023-07-15 19:06:58,932 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=158 updating hbase:meta row=7e496e21c7d001317d5cf585a8130f26, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:58,933 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448018932"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448018932"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448018932"}]},"ts":"1689448018932"} 2023-07-15 19:06:58,933 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=153 updating hbase:meta row=444ed713f9dba45050a25f589f763038, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:58,933 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448018933"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689448018933"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689448018933"}]},"ts":"1689448018933"} 2023-07-15 19:06:58,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=166, ppid=159, state=RUNNABLE; OpenRegionProcedure 4814b2c3e764165368b352d42887446c, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:06:58,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=167, ppid=157, state=RUNNABLE; OpenRegionProcedure 92b70f6d151941fd1db7b5555e62dbff, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:58,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=168, ppid=158, state=RUNNABLE; OpenRegionProcedure 7e496e21c7d001317d5cf585a8130f26, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:58,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=169, ppid=153, state=RUNNABLE; OpenRegionProcedure 444ed713f9dba45050a25f589f763038, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:06:58,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=151 2023-07-15 19:06:59,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64. 2023-07-15 19:06:59,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b2377074d2f148303e8254e6335df64, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64.', STARTKEY => '', ENDKEY => '4', REPLICA_ID => 2} 2023-07-15 19:06:59,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:06:59,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71ec91d4744bf2d970141091f4a1cca3, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.', STARTKEY => '', ENDKEY => '4'} 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 9b2377074d2f148303e8254e6335df64 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b2377074d2f148303e8254e6335df64 2023-07-15 19:06:59,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff. 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b2377074d2f148303e8254e6335df64 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92b70f6d151941fd1db7b5555e62dbff, NAME => 'testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff.', STARTKEY => '4', ENDKEY => '7', REPLICA_ID => 2} 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 92b70f6d151941fd1db7b5555e62dbff 2023-07-15 19:06:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 92b70f6d151941fd1db7b5555e62dbff 2023-07-15 19:06:59,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 92b70f6d151941fd1db7b5555e62dbff 2023-07-15 19:06:59,090 INFO [StoreOpener-9b2377074d2f148303e8254e6335df64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 9b2377074d2f148303e8254e6335df64 2023-07-15 19:06:59,090 INFO [StoreOpener-92b70f6d151941fd1db7b5555e62dbff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 92b70f6d151941fd1db7b5555e62dbff 2023-07-15 19:06:59,090 INFO [StoreOpener-71ec91d4744bf2d970141091f4a1cca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:59,092 DEBUG [StoreOpener-9b2377074d2f148303e8254e6335df64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f 2023-07-15 19:06:59,092 DEBUG [StoreOpener-71ec91d4744bf2d970141091f4a1cca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f 2023-07-15 19:06:59,092 DEBUG [StoreOpener-92b70f6d151941fd1db7b5555e62dbff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f 2023-07-15 19:06:59,092 DEBUG [StoreOpener-9b2377074d2f148303e8254e6335df64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f 2023-07-15 19:06:59,092 DEBUG [StoreOpener-92b70f6d151941fd1db7b5555e62dbff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f 2023-07-15 19:06:59,092 DEBUG [StoreOpener-71ec91d4744bf2d970141091f4a1cca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f 2023-07-15 19:06:59,092 INFO [StoreOpener-9b2377074d2f148303e8254e6335df64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b2377074d2f148303e8254e6335df64 columnFamilyName f 2023-07-15 19:06:59,092 INFO [StoreOpener-71ec91d4744bf2d970141091f4a1cca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71ec91d4744bf2d970141091f4a1cca3 columnFamilyName f 2023-07-15 19:06:59,092 INFO [StoreOpener-92b70f6d151941fd1db7b5555e62dbff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92b70f6d151941fd1db7b5555e62dbff columnFamilyName f 2023-07-15 19:06:59,093 INFO [StoreOpener-9b2377074d2f148303e8254e6335df64-1] regionserver.HStore(310): Store=9b2377074d2f148303e8254e6335df64/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,093 INFO [StoreOpener-71ec91d4744bf2d970141091f4a1cca3-1] regionserver.HStore(310): Store=71ec91d4744bf2d970141091f4a1cca3/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,093 INFO [StoreOpener-92b70f6d151941fd1db7b5555e62dbff-1] regionserver.HStore(310): Store=92b70f6d151941fd1db7b5555e62dbff/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:59,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:59,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 92b70f6d151941fd1db7b5555e62dbff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60779434, jitterRate=-0.09431585669517517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 92b70f6d151941fd1db7b5555e62dbff: 2023-07-15 19:06:59,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b2377074d2f148303e8254e6335df64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59162132, jitterRate=-0.11841553449630737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff., pid=167, masterSystemTime=1689448019086 2023-07-15 19:06:59,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b2377074d2f148303e8254e6335df64: 2023-07-15 19:06:59,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64., pid=163, masterSystemTime=1689448019081 2023-07-15 19:06:59,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff. 2023-07-15 19:06:59,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff. 2023-07-15 19:06:59,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:06:59,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7e496e21c7d001317d5cf585a8130f26, NAME => 'testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.', STARTKEY => '7', ENDKEY => ''} 2023-07-15 19:06:59,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64. 2023-07-15 19:06:59,097 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=157 updating hbase:meta row=92b70f6d151941fd1db7b5555e62dbff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:59,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64. 2023-07-15 19:06:59,097 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448019097"},{"qualifier":"server_0002","vlen":31,"tag":[],"timestamp":"1689448019097"},{"qualifier":"serverstartcode_0002","vlen":8,"tag":[],"timestamp":"1689448019097"},{"qualifier":"seqnumDuringOpen_0002","vlen":8,"tag":[],"timestamp":"1689448019097"}]},"ts":"1689448019097"} 2023-07-15 19:06:59,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c. 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4814b2c3e764165368b352d42887446c, NAME => 'testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c.', STARTKEY => '7', ENDKEY => '', REPLICA_ID => 1} 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 4814b2c3e764165368b352d42887446c 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4814b2c3e764165368b352d42887446c 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4814b2c3e764165368b352d42887446c 2023-07-15 19:06:59,098 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=154 updating hbase:meta row=9b2377074d2f148303e8254e6335df64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:59,098 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448019098"},{"qualifier":"server_0002","vlen":31,"tag":[],"timestamp":"1689448019098"},{"qualifier":"serverstartcode_0002","vlen":8,"tag":[],"timestamp":"1689448019098"},{"qualifier":"seqnumDuringOpen_0002","vlen":8,"tag":[],"timestamp":"1689448019098"}]},"ts":"1689448019098"} 2023-07-15 19:06:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:06:59,099 INFO [StoreOpener-4814b2c3e764165368b352d42887446c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 4814b2c3e764165368b352d42887446c 2023-07-15 19:06:59,100 INFO [StoreOpener-7e496e21c7d001317d5cf585a8130f26-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:59,101 DEBUG [StoreOpener-4814b2c3e764165368b352d42887446c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f 2023-07-15 19:06:59,102 DEBUG [StoreOpener-4814b2c3e764165368b352d42887446c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f 2023-07-15 19:06:59,102 DEBUG [StoreOpener-7e496e21c7d001317d5cf585a8130f26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f 2023-07-15 19:06:59,102 DEBUG [StoreOpener-7e496e21c7d001317d5cf585a8130f26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f 2023-07-15 19:06:59,102 INFO [StoreOpener-4814b2c3e764165368b352d42887446c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4814b2c3e764165368b352d42887446c columnFamilyName f 2023-07-15 19:06:59,102 INFO [StoreOpener-7e496e21c7d001317d5cf585a8130f26-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e496e21c7d001317d5cf585a8130f26 columnFamilyName f 2023-07-15 19:06:59,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:59,103 INFO [StoreOpener-4814b2c3e764165368b352d42887446c-1] regionserver.HStore(310): Store=4814b2c3e764165368b352d42887446c/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,103 INFO [StoreOpener-7e496e21c7d001317d5cf585a8130f26-1] regionserver.HStore(310): Store=7e496e21c7d001317d5cf585a8130f26/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 71ec91d4744bf2d970141091f4a1cca3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74078838, jitterRate=0.10386070609092712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 71ec91d4744bf2d970141091f4a1cca3: 2023-07-15 19:06:59,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:59,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3., pid=161, masterSystemTime=1689448019081 2023-07-15 19:06:59,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:59,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4814b2c3e764165368b352d42887446c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68534034, jitterRate=0.021236687898635864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4814b2c3e764165368b352d42887446c: 2023-07-15 19:06:59,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c., pid=166, masterSystemTime=1689448019081 2023-07-15 19:06:59,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:06:59,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:59,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7e496e21c7d001317d5cf585a8130f26; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65651645, jitterRate=-0.021714255213737488}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7e496e21c7d001317d5cf585a8130f26: 2023-07-15 19:06:59,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26., pid=168, masterSystemTime=1689448019086 2023-07-15 19:06:59,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:06:59,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:06:59,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811. 2023-07-15 19:06:59,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c. 2023-07-15 19:06:59,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b01706d08a57198ac1f922201f72811, NAME => 'testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811.', STARTKEY => '7', ENDKEY => '', REPLICA_ID => 2} 2023-07-15 19:06:59,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c. 2023-07-15 19:06:59,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 577e272d9eea3fb0c7b6721baf1c28f8, NAME => 'testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.', STARTKEY => '4', ENDKEY => '7'} 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 3b01706d08a57198ac1f922201f72811 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3b01706d08a57198ac1f922201f72811 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3b01706d08a57198ac1f922201f72811 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:59,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:59,112 INFO [StoreOpener-3b01706d08a57198ac1f922201f72811-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 3b01706d08a57198ac1f922201f72811 2023-07-15 19:06:59,112 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=159 updating hbase:meta row=4814b2c3e764165368b352d42887446c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:59,113 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448019112"},{"qualifier":"server_0001","vlen":31,"tag":[],"timestamp":"1689448019112"},{"qualifier":"serverstartcode_0001","vlen":8,"tag":[],"timestamp":"1689448019112"},{"qualifier":"seqnumDuringOpen_0001","vlen":8,"tag":[],"timestamp":"1689448019112"}]},"ts":"1689448019112"} 2023-07-15 19:06:59,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:06:59,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:06:59,112 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=152 updating hbase:meta row=71ec91d4744bf2d970141091f4a1cca3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:59,113 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448019112"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448019112"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448019112"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448019112"}]},"ts":"1689448019112"} 2023-07-15 19:06:59,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:06:59,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 444ed713f9dba45050a25f589f763038, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038.', STARTKEY => '', ENDKEY => '4', REPLICA_ID => 1} 2023-07-15 19:06:59,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 444ed713f9dba45050a25f589f763038 2023-07-15 19:06:59,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 444ed713f9dba45050a25f589f763038 2023-07-15 19:06:59,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 444ed713f9dba45050a25f589f763038 2023-07-15 19:06:59,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=167, resume processing ppid=157 2023-07-15 19:06:59,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=163, resume processing ppid=154 2023-07-15 19:06:59,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=167, ppid=157, state=SUCCESS; OpenRegionProcedure 92b70f6d151941fd1db7b5555e62dbff, server=jenkins-hbase4.apache.org,36223,1689447992001 in 167 msec 2023-07-15 19:06:59,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=163, ppid=154, state=SUCCESS; OpenRegionProcedure 9b2377074d2f148303e8254e6335df64, server=jenkins-hbase4.apache.org,42217,1689447992037 in 172 msec 2023-07-15 19:06:59,115 DEBUG [StoreOpener-3b01706d08a57198ac1f922201f72811-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f 2023-07-15 19:06:59,115 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=158 updating hbase:meta row=7e496e21c7d001317d5cf585a8130f26, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:59,115 DEBUG [StoreOpener-3b01706d08a57198ac1f922201f72811-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f 2023-07-15 19:06:59,115 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448019115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448019115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448019115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448019115"}]},"ts":"1689448019115"} 2023-07-15 19:06:59,116 INFO [StoreOpener-3b01706d08a57198ac1f922201f72811-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b01706d08a57198ac1f922201f72811 columnFamilyName f 2023-07-15 19:06:59,116 INFO [StoreOpener-3b01706d08a57198ac1f922201f72811-1] regionserver.HStore(310): Store=3b01706d08a57198ac1f922201f72811/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=154, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=9b2377074d2f148303e8254e6335df64, ASSIGN in 347 msec 2023-07-15 19:06:59,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=157, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=92b70f6d151941fd1db7b5555e62dbff, ASSIGN in 347 msec 2023-07-15 19:06:59,118 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=161, resume processing ppid=152 2023-07-15 19:06:59,118 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=161, ppid=152, state=SUCCESS; OpenRegionProcedure 71ec91d4744bf2d970141091f4a1cca3, server=jenkins-hbase4.apache.org,42361,1689447991925 in 185 msec 2023-07-15 19:06:59,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=166, resume processing ppid=159 2023-07-15 19:06:59,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=166, ppid=159, state=SUCCESS; OpenRegionProcedure 4814b2c3e764165368b352d42887446c, server=jenkins-hbase4.apache.org,42217,1689447992037 in 180 msec 2023-07-15 19:06:59,119 INFO [StoreOpener-444ed713f9dba45050a25f589f763038-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 444ed713f9dba45050a25f589f763038 2023-07-15 19:06:59,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=159, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=4814b2c3e764165368b352d42887446c, ASSIGN in 350 msec 2023-07-15 19:06:59,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=152, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=71ec91d4744bf2d970141091f4a1cca3, ASSIGN in 350 msec 2023-07-15 19:06:59,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=168, resume processing ppid=158 2023-07-15 19:06:59,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=168, ppid=158, state=SUCCESS; OpenRegionProcedure 7e496e21c7d001317d5cf585a8130f26, server=jenkins-hbase4.apache.org,36223,1689447992001 in 183 msec 2023-07-15 19:06:59,120 DEBUG [StoreOpener-444ed713f9dba45050a25f589f763038-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f 2023-07-15 19:06:59,120 DEBUG [StoreOpener-444ed713f9dba45050a25f589f763038-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f 2023-07-15 19:06:59,120 INFO [StoreOpener-444ed713f9dba45050a25f589f763038-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 444ed713f9dba45050a25f589f763038 columnFamilyName f 2023-07-15 19:06:59,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=158, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7e496e21c7d001317d5cf585a8130f26, ASSIGN in 352 msec 2023-07-15 19:06:59,123 INFO [StoreOpener-444ed713f9dba45050a25f589f763038-1] regionserver.HStore(310): Store=444ed713f9dba45050a25f589f763038/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,123 INFO [StoreOpener-577e272d9eea3fb0c7b6721baf1c28f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:59,124 DEBUG [StoreOpener-577e272d9eea3fb0c7b6721baf1c28f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f 2023-07-15 19:06:59,124 DEBUG [StoreOpener-577e272d9eea3fb0c7b6721baf1c28f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f 2023-07-15 19:06:59,124 INFO [StoreOpener-577e272d9eea3fb0c7b6721baf1c28f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 577e272d9eea3fb0c7b6721baf1c28f8 columnFamilyName f 2023-07-15 19:06:59,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 444ed713f9dba45050a25f589f763038; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59329454, jitterRate=-0.1159222424030304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 444ed713f9dba45050a25f589f763038: 2023-07-15 19:06:59,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038., pid=169, masterSystemTime=1689448019086 2023-07-15 19:06:59,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3b01706d08a57198ac1f922201f72811; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58857574, jitterRate=-0.12295380234718323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3b01706d08a57198ac1f922201f72811: 2023-07-15 19:06:59,125 INFO [StoreOpener-577e272d9eea3fb0c7b6721baf1c28f8-1] regionserver.HStore(310): Store=577e272d9eea3fb0c7b6721baf1c28f8/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811., pid=162, masterSystemTime=1689448019081 2023-07-15 19:06:59,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:59,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:06:59,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:06:59,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:59,127 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=153 updating hbase:meta row=444ed713f9dba45050a25f589f763038, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:06:59,127 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448019126"},{"qualifier":"server_0001","vlen":31,"tag":[],"timestamp":"1689448019126"},{"qualifier":"serverstartcode_0001","vlen":8,"tag":[],"timestamp":"1689448019126"},{"qualifier":"seqnumDuringOpen_0001","vlen":8,"tag":[],"timestamp":"1689448019126"}]},"ts":"1689448019126"} 2023-07-15 19:06:59,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811. 2023-07-15 19:06:59,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811. 2023-07-15 19:06:59,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580. 2023-07-15 19:06:59,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ac5281096e622acd7d0636cab3f2580, NAME => 'testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580.', STARTKEY => '4', ENDKEY => '7', REPLICA_ID => 1} 2023-07-15 19:06:59,127 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=160 updating hbase:meta row=3b01706d08a57198ac1f922201f72811, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:59,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitAndMergeWithReplicaTable 7ac5281096e622acd7d0636cab3f2580 2023-07-15 19:06:59,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448019127"},{"qualifier":"server_0002","vlen":31,"tag":[],"timestamp":"1689448019127"},{"qualifier":"serverstartcode_0002","vlen":8,"tag":[],"timestamp":"1689448019127"},{"qualifier":"seqnumDuringOpen_0002","vlen":8,"tag":[],"timestamp":"1689448019127"}]},"ts":"1689448019127"} 2023-07-15 19:06:59,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:06:59,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ac5281096e622acd7d0636cab3f2580 2023-07-15 19:06:59,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ac5281096e622acd7d0636cab3f2580 2023-07-15 19:06:59,128 INFO [StoreOpener-7ac5281096e622acd7d0636cab3f2580-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 7ac5281096e622acd7d0636cab3f2580 2023-07-15 19:06:59,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:06:59,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=169, resume processing ppid=153 2023-07-15 19:06:59,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=169, ppid=153, state=SUCCESS; OpenRegionProcedure 444ed713f9dba45050a25f589f763038, server=jenkins-hbase4.apache.org,36223,1689447992001 in 194 msec 2023-07-15 19:06:59,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=162, resume processing ppid=160 2023-07-15 19:06:59,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=162, ppid=160, state=SUCCESS; OpenRegionProcedure 3b01706d08a57198ac1f922201f72811, server=jenkins-hbase4.apache.org,42361,1689447991925 in 200 msec 2023-07-15 19:06:59,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:06:59,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 577e272d9eea3fb0c7b6721baf1c28f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71126983, jitterRate=0.05987463891506195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 577e272d9eea3fb0c7b6721baf1c28f8: 2023-07-15 19:06:59,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=153, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=444ed713f9dba45050a25f589f763038, ASSIGN in 362 msec 2023-07-15 19:06:59,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8., pid=165, masterSystemTime=1689448019081 2023-07-15 19:06:59,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=160, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=3b01706d08a57198ac1f922201f72811, ASSIGN in 363 msec 2023-07-15 19:06:59,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:06:59,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:06:59,136 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=155 updating hbase:meta row=577e272d9eea3fb0c7b6721baf1c28f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:06:59,136 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448019136"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448019136"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448019136"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448019136"}]},"ts":"1689448019136"} 2023-07-15 19:06:59,137 DEBUG [StoreOpener-7ac5281096e622acd7d0636cab3f2580-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f 2023-07-15 19:06:59,137 DEBUG [StoreOpener-7ac5281096e622acd7d0636cab3f2580-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f 2023-07-15 19:06:59,137 INFO [StoreOpener-7ac5281096e622acd7d0636cab3f2580-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ac5281096e622acd7d0636cab3f2580 columnFamilyName f 2023-07-15 19:06:59,138 INFO [StoreOpener-7ac5281096e622acd7d0636cab3f2580-1] regionserver.HStore(310): Store=7ac5281096e622acd7d0636cab3f2580/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:06:59,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=165, resume processing ppid=155 2023-07-15 19:06:59,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=165, ppid=155, state=SUCCESS; OpenRegionProcedure 577e272d9eea3fb0c7b6721baf1c28f8, server=jenkins-hbase4.apache.org,42217,1689447992037 in 208 msec 2023-07-15 19:06:59,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ac5281096e622acd7d0636cab3f2580; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73154785, jitterRate=0.09009124338626862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:06:59,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ac5281096e622acd7d0636cab3f2580: 2023-07-15 19:06:59,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580., pid=164, masterSystemTime=1689448019081 2023-07-15 19:06:59,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=155, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=577e272d9eea3fb0c7b6721baf1c28f8, ASSIGN in 371 msec 2023-07-15 19:06:59,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580. 2023-07-15 19:06:59,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580. 2023-07-15 19:06:59,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=156 updating hbase:meta row=7ac5281096e622acd7d0636cab3f2580, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:06:59,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448019141"},{"qualifier":"server_0001","vlen":31,"tag":[],"timestamp":"1689448019141"},{"qualifier":"serverstartcode_0001","vlen":8,"tag":[],"timestamp":"1689448019141"},{"qualifier":"seqnumDuringOpen_0001","vlen":8,"tag":[],"timestamp":"1689448019141"}]},"ts":"1689448019141"} 2023-07-15 19:06:59,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=164, resume processing ppid=156 2023-07-15 19:06:59,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=164, ppid=156, state=SUCCESS; OpenRegionProcedure 7ac5281096e622acd7d0636cab3f2580, server=jenkins-hbase4.apache.org,42361,1689447991925 in 212 msec 2023-07-15 19:06:59,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=156, resume processing ppid=151 2023-07-15 19:06:59,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=156, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7ac5281096e622acd7d0636cab3f2580, ASSIGN in 376 msec 2023-07-15 19:06:59,145 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=151, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testSplitAndMergeWithReplicaTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:06:59,146 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448019145"}]},"ts":"1689448019145"} 2023-07-15 19:06:59,146 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testSplitAndMergeWithReplicaTable, state=ENABLED in hbase:meta 2023-07-15 19:06:59,149 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=151, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testSplitAndMergeWithReplicaTable execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:06:59,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=151, state=SUCCESS; CreateTableProcedure table=testSplitAndMergeWithReplicaTable in 446 msec 2023-07-15 19:06:59,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=151 2023-07-15 19:06:59,458 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testSplitAndMergeWithReplicaTable, procId: 151 completed 2023-07-15 19:06:59,479 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:06:59,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:06:59,479 ERROR [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.RpcServer(450): Unexpected throwable object java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:06:59,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 490 service: MasterService methodName: SplitRegion size: 115 connection: 172.31.14.131:58506 deadline: 1689448079479, exception=java.io.IOException: Can't invoke split on non-default regions directly 2023-07-15 19:06:59,633 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 19:06:59,733 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:06:59,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:06:59,734 ERROR [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.RpcServer(450): Unexpected throwable object java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:06:59,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 492 service: MasterService methodName: SplitRegion size: 115 connection: 172.31.14.131:58506 deadline: 1689448079733, exception=java.io.IOException: Can't invoke split on non-default regions directly 2023-07-15 19:07:00,235 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:00,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:00,236 ERROR [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.RpcServer(450): Unexpected throwable object java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:00,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 494 service: MasterService methodName: SplitRegion size: 115 connection: 172.31.14.131:58506 deadline: 1689448080235, exception=java.io.IOException: Can't invoke split on non-default regions directly 2023-07-15 19:07:00,992 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:00,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:00,992 ERROR [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.RpcServer(450): Unexpected throwable object java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:00,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 496 service: MasterService methodName: SplitRegion size: 115 connection: 172.31.14.131:58506 deadline: 1689448080992, exception=java.io.IOException: Can't invoke split on non-default regions directly 2023-07-15 19:07:02,255 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:02,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:02,255 ERROR [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.RpcServer(450): Unexpected throwable object java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:02,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 498 service: MasterService methodName: SplitRegion size: 115 connection: 172.31.14.131:58506 deadline: 1689448082255, exception=java.io.IOException: Can't invoke split on non-default regions directly 2023-07-15 19:07:03,496 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testSplitAndMergeWithReplicaTable' 2023-07-15 19:07:04,592 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 19:07:04,777 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:04,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:04,777 ERROR [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.RpcServer(450): Unexpected throwable object java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:04,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 500 service: MasterService methodName: SplitRegion size: 115 connection: 172.31.14.131:58506 deadline: 1689448084776, exception=java.io.IOException: Can't invoke split on non-default regions directly 2023-07-15 19:07:09,812 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$3(1981): Client=jenkins//172.31.14.131 split testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:09,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:09,813 ERROR [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.RpcServer(450): Unexpected throwable object java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:09,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 502 service: MasterService methodName: SplitRegion size: 115 connection: 172.31.14.131:58506 deadline: 1689448089812, exception=java.io.IOException: Can't invoke split on non-default regions directly 2023-07-15 19:07:09,815 DEBUG [Listener at localhost/45529] client.RpcRetryingCallerImpl(129): Call exception, tries=6, retries=7, started=10335 ms ago, cancelled=false, msg=java.io.IOException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:451) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) ... 3 more , details=, see https://s.apache.org/timeout, exception=java.io.IOException: java.io.IOException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:451) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) ... 3 more at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:2954) at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:2946) at org.apache.hadoop.hbase.client.HBaseAdmin.splitRegionAsync(HBaseAdmin.java:1788) at org.apache.hadoop.hbase.client.TestAdmin1.testSplitAndMergeWithReplicaTable(TestAdmin1.java:438) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(java.io.IOException): java.io.IOException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:451) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: java.lang.IllegalArgumentException: Can't invoke split on non-default regions directly at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.checkSplittable(SplitTableRegionProcedure.java:196) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:131) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) ... 3 more at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-15 19:07:09,827 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 444ed713f9dba45050a25f589f763038, 9b2377074d2f148303e8254e6335df64 2023-07-15 19:07:09,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.exceptions.MergeRegionException: Can't merge non-default replicas; {ENCODED => 444ed713f9dba45050a25f589f763038, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038.', STARTKEY => '', ENDKEY => '4', REPLICA_ID => 1} at org.apache.hadoop.hbase.master.assignment.MergeTableRegionsProcedure.checkRegionsToMerge(MergeTableRegionsProcedure.java:142) at org.apache.hadoop.hbase.master.assignment.MergeTableRegionsProcedure.(MergeTableRegionsProcedure.java:102) at org.apache.hadoop.hbase.master.HMaster$2.run(HMaster.java:1953) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.mergeRegions(HMaster.java:1947) at org.apache.hadoop.hbase.master.MasterRpcServices.mergeTableRegions(MasterRpcServices.java:854) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 19:07:09,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] ipc.CallRunner(144): callId: 506 service: MasterService methodName: MergeTableRegions size: 114 connection: 172.31.14.131:58506 deadline: 1689448089826, exception=org.apache.hadoop.hbase.exceptions.MergeRegionException: Can't merge non-default replicas; {ENCODED => 444ed713f9dba45050a25f589f763038, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038.', STARTKEY => '', ENDKEY => '4', REPLICA_ID => 1} 2023-07-15 19:07:09,831 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testSplitAndMergeWithReplicaTable 2023-07-15 19:07:09,832 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testSplitAndMergeWithReplicaTable 2023-07-15 19:07:09,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=177, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSplitAndMergeWithReplicaTable 2023-07-15 19:07:09,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=177 2023-07-15 19:07:09,835 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448029835"}]},"ts":"1689448029835"} 2023-07-15 19:07:09,836 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitAndMergeWithReplicaTable, state=DISABLING in hbase:meta 2023-07-15 19:07:09,838 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testSplitAndMergeWithReplicaTable to state=DISABLING 2023-07-15 19:07:09,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=178, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=71ec91d4744bf2d970141091f4a1cca3, UNASSIGN}, {pid=179, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=444ed713f9dba45050a25f589f763038, UNASSIGN}, {pid=180, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=9b2377074d2f148303e8254e6335df64, UNASSIGN}, {pid=181, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=577e272d9eea3fb0c7b6721baf1c28f8, UNASSIGN}, {pid=182, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7ac5281096e622acd7d0636cab3f2580, UNASSIGN}, {pid=183, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=92b70f6d151941fd1db7b5555e62dbff, UNASSIGN}, {pid=184, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7e496e21c7d001317d5cf585a8130f26, UNASSIGN}, {pid=185, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=4814b2c3e764165368b352d42887446c, UNASSIGN}, {pid=186, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=3b01706d08a57198ac1f922201f72811, UNASSIGN}] 2023-07-15 19:07:09,840 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=178, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=71ec91d4744bf2d970141091f4a1cca3, UNASSIGN 2023-07-15 19:07:09,840 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=182, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7ac5281096e622acd7d0636cab3f2580, UNASSIGN 2023-07-15 19:07:09,840 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=186, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=3b01706d08a57198ac1f922201f72811, UNASSIGN 2023-07-15 19:07:09,840 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=183, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=92b70f6d151941fd1db7b5555e62dbff, UNASSIGN 2023-07-15 19:07:09,840 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=181, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=577e272d9eea3fb0c7b6721baf1c28f8, UNASSIGN 2023-07-15 19:07:09,841 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=178 updating hbase:meta row=71ec91d4744bf2d970141091f4a1cca3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:09,841 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448029841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448029841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448029841"}]},"ts":"1689448029841"} 2023-07-15 19:07:09,841 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=182 updating hbase:meta row=7ac5281096e622acd7d0636cab3f2580, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:09,841 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=181 updating hbase:meta row=577e272d9eea3fb0c7b6721baf1c28f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:09,841 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=186 updating hbase:meta row=3b01706d08a57198ac1f922201f72811, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:09,841 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448029841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448029841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448029841"}]},"ts":"1689448029841"} 2023-07-15 19:07:09,841 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448029841"},{"qualifier":"sn_0002","vlen":45,"tag":[],"timestamp":"1689448029841"},{"qualifier":"state_0002","vlen":7,"tag":[],"timestamp":"1689448029841"}]},"ts":"1689448029841"} 2023-07-15 19:07:09,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=183 updating hbase:meta row=92b70f6d151941fd1db7b5555e62dbff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:09,841 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448029841"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689448029841"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689448029841"}]},"ts":"1689448029841"} 2023-07-15 19:07:09,842 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448029841"},{"qualifier":"sn_0002","vlen":45,"tag":[],"timestamp":"1689448029841"},{"qualifier":"state_0002","vlen":7,"tag":[],"timestamp":"1689448029841"}]},"ts":"1689448029841"} 2023-07-15 19:07:09,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=187, ppid=178, state=RUNNABLE; CloseRegionProcedure 71ec91d4744bf2d970141091f4a1cca3, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:07:09,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=188, ppid=181, state=RUNNABLE; CloseRegionProcedure 577e272d9eea3fb0c7b6721baf1c28f8, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:09,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=189, ppid=186, state=RUNNABLE; CloseRegionProcedure 3b01706d08a57198ac1f922201f72811, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:07:09,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=190, ppid=182, state=RUNNABLE; CloseRegionProcedure 7ac5281096e622acd7d0636cab3f2580, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:07:09,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=191, ppid=183, state=RUNNABLE; CloseRegionProcedure 92b70f6d151941fd1db7b5555e62dbff, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:07:09,846 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=185, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=4814b2c3e764165368b352d42887446c, UNASSIGN 2023-07-15 19:07:09,848 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=184, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7e496e21c7d001317d5cf585a8130f26, UNASSIGN 2023-07-15 19:07:09,848 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=185 updating hbase:meta row=4814b2c3e764165368b352d42887446c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:09,848 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=180, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=9b2377074d2f148303e8254e6335df64, UNASSIGN 2023-07-15 19:07:09,848 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448029848"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689448029848"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689448029848"}]},"ts":"1689448029848"} 2023-07-15 19:07:09,849 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=179, ppid=177, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=444ed713f9dba45050a25f589f763038, UNASSIGN 2023-07-15 19:07:09,849 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=184 updating hbase:meta row=7e496e21c7d001317d5cf585a8130f26, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:09,849 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448029849"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448029849"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448029849"}]},"ts":"1689448029849"} 2023-07-15 19:07:09,849 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=180 updating hbase:meta row=9b2377074d2f148303e8254e6335df64, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:09,849 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448029849"},{"qualifier":"sn_0002","vlen":45,"tag":[],"timestamp":"1689448029849"},{"qualifier":"state_0002","vlen":7,"tag":[],"timestamp":"1689448029849"}]},"ts":"1689448029849"} 2023-07-15 19:07:09,850 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=179 updating hbase:meta row=444ed713f9dba45050a25f589f763038, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:09,850 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448029850"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689448029850"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689448029850"}]},"ts":"1689448029850"} 2023-07-15 19:07:09,850 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=192, ppid=185, state=RUNNABLE; CloseRegionProcedure 4814b2c3e764165368b352d42887446c, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:09,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=193, ppid=184, state=RUNNABLE; CloseRegionProcedure 7e496e21c7d001317d5cf585a8130f26, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:07:09,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=194, ppid=180, state=RUNNABLE; CloseRegionProcedure 9b2377074d2f148303e8254e6335df64, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:09,852 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=195, ppid=179, state=RUNNABLE; CloseRegionProcedure 444ed713f9dba45050a25f589f763038, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:07:09,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ac5281096e622acd7d0636cab3f2580 2023-07-15 19:07:09,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ac5281096e622acd7d0636cab3f2580, disabling compactions & flushes 2023-07-15 19:07:09,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580. 2023-07-15 19:07:09,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580. 2023-07-15 19:07:09,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580. after waiting 0 ms 2023-07-15 19:07:09,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580. 2023-07-15 19:07:09,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b2377074d2f148303e8254e6335df64 2023-07-15 19:07:09,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 444ed713f9dba45050a25f589f763038 2023-07-15 19:07:09,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b2377074d2f148303e8254e6335df64, disabling compactions & flushes 2023-07-15 19:07:09,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 444ed713f9dba45050a25f589f763038, disabling compactions & flushes 2023-07-15 19:07:09,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64. 2023-07-15 19:07:09,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:09,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580. 2023-07-15 19:07:09,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64. 2023-07-15 19:07:09,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ac5281096e622acd7d0636cab3f2580: 2023-07-15 19:07:09,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64. after waiting 0 ms 2023-07-15 19:07:09,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:09,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64. 2023-07-15 19:07:09,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. after waiting 0 ms 2023-07-15 19:07:09,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:10,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64. 2023-07-15 19:07:10,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038. 2023-07-15 19:07:10,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 444ed713f9dba45050a25f589f763038: 2023-07-15 19:07:10,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b2377074d2f148303e8254e6335df64: 2023-07-15 19:07:10,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ac5281096e622acd7d0636cab3f2580 2023-07-15 19:07:10,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3b01706d08a57198ac1f922201f72811 2023-07-15 19:07:10,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3b01706d08a57198ac1f922201f72811, disabling compactions & flushes 2023-07-15 19:07:10,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811. 2023-07-15 19:07:10,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811. 2023-07-15 19:07:10,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b2377074d2f148303e8254e6335df64 2023-07-15 19:07:10,003 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=182 updating hbase:meta row=7ac5281096e622acd7d0636cab3f2580, regionState=CLOSED 2023-07-15 19:07:10,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4814b2c3e764165368b352d42887446c 2023-07-15 19:07:10,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 444ed713f9dba45050a25f589f763038 2023-07-15 19:07:10,003 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448030003"},{"qualifier":"state_0001","vlen":6,"tag":[],"timestamp":"1689448030003"}]},"ts":"1689448030003"} 2023-07-15 19:07:10,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811. after waiting 0 ms 2023-07-15 19:07:10,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4814b2c3e764165368b352d42887446c, disabling compactions & flushes 2023-07-15 19:07:10,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c. 2023-07-15 19:07:10,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 92b70f6d151941fd1db7b5555e62dbff 2023-07-15 19:07:10,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c. 2023-07-15 19:07:10,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c. after waiting 0 ms 2023-07-15 19:07:10,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811. 2023-07-15 19:07:10,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 92b70f6d151941fd1db7b5555e62dbff, disabling compactions & flushes 2023-07-15 19:07:10,005 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=179 updating hbase:meta row=444ed713f9dba45050a25f589f763038, regionState=CLOSED 2023-07-15 19:07:10,005 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=180 updating hbase:meta row=9b2377074d2f148303e8254e6335df64, regionState=CLOSED 2023-07-15 19:07:10,005 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448030005"},{"qualifier":"state_0001","vlen":6,"tag":[],"timestamp":"1689448030005"}]},"ts":"1689448030005"} 2023-07-15 19:07:10,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c. 2023-07-15 19:07:10,005 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448030005"},{"qualifier":"state_0002","vlen":6,"tag":[],"timestamp":"1689448030005"}]},"ts":"1689448030005"} 2023-07-15 19:07:10,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff. 2023-07-15 19:07:10,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff. 2023-07-15 19:07:10,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff. after waiting 0 ms 2023-07-15 19:07:10,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811. 2023-07-15 19:07:10,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3b01706d08a57198ac1f922201f72811: 2023-07-15 19:07:10,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff. 2023-07-15 19:07:10,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c. 2023-07-15 19:07:10,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4814b2c3e764165368b352d42887446c: 2023-07-15 19:07:10,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff. 2023-07-15 19:07:10,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 92b70f6d151941fd1db7b5555e62dbff: 2023-07-15 19:07:10,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3b01706d08a57198ac1f922201f72811 2023-07-15 19:07:10,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:07:10,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4814b2c3e764165368b352d42887446c 2023-07-15 19:07:10,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:07:10,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 71ec91d4744bf2d970141091f4a1cca3, disabling compactions & flushes 2023-07-15 19:07:10,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 92b70f6d151941fd1db7b5555e62dbff 2023-07-15 19:07:10,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:07:10,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:07:10,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 577e272d9eea3fb0c7b6721baf1c28f8, disabling compactions & flushes 2023-07-15 19:07:10,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7e496e21c7d001317d5cf585a8130f26, disabling compactions & flushes 2023-07-15 19:07:10,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=195, resume processing ppid=179 2023-07-15 19:07:10,011 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=186 updating hbase:meta row=3b01706d08a57198ac1f922201f72811, regionState=CLOSED 2023-07-15 19:07:10,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:07:10,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. after waiting 0 ms 2023-07-15 19:07:10,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:07:10,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 71ec91d4744bf2d970141091f4a1cca3 1/1 column families, dataSize=26 B heapSize=360 B 2023-07-15 19:07:10,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=195, ppid=179, state=SUCCESS; CloseRegionProcedure 444ed713f9dba45050a25f589f763038, server=jenkins-hbase4.apache.org,36223,1689447992001 in 156 msec 2023-07-15 19:07:10,011 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=185 updating hbase:meta row=4814b2c3e764165368b352d42887446c, regionState=CLOSED 2023-07-15 19:07:10,012 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448030011"},{"qualifier":"state_0002","vlen":6,"tag":[],"timestamp":"1689448030011"}]},"ts":"1689448030011"} 2023-07-15 19:07:10,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=190, resume processing ppid=182 2023-07-15 19:07:10,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:07:10,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=190, ppid=182, state=SUCCESS; CloseRegionProcedure 7ac5281096e622acd7d0636cab3f2580, server=jenkins-hbase4.apache.org,42361,1689447991925 in 164 msec 2023-07-15 19:07:10,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:07:10,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:07:10,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. after waiting 0 ms 2023-07-15 19:07:10,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=194, resume processing ppid=180 2023-07-15 19:07:10,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=194, ppid=180, state=SUCCESS; CloseRegionProcedure 9b2377074d2f148303e8254e6335df64, server=jenkins-hbase4.apache.org,42217,1689447992037 in 158 msec 2023-07-15 19:07:10,013 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448030011"},{"qualifier":"state_0001","vlen":6,"tag":[],"timestamp":"1689448030011"}]},"ts":"1689448030011"} 2023-07-15 19:07:10,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:07:10,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7e496e21c7d001317d5cf585a8130f26 1/1 column families, dataSize=26 B heapSize=360 B 2023-07-15 19:07:10,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:07:10,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. after waiting 0 ms 2023-07-15 19:07:10,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:07:10,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 577e272d9eea3fb0c7b6721baf1c28f8 1/1 column families, dataSize=26 B heapSize=360 B 2023-07-15 19:07:10,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=182, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7ac5281096e622acd7d0636cab3f2580, UNASSIGN in 175 msec 2023-07-15 19:07:10,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=179, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=444ed713f9dba45050a25f589f763038, UNASSIGN in 175 msec 2023-07-15 19:07:10,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=180, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=9b2377074d2f148303e8254e6335df64, UNASSIGN in 176 msec 2023-07-15 19:07:10,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=183 updating hbase:meta row=92b70f6d151941fd1db7b5555e62dbff, regionState=CLOSED 2023-07-15 19:07:10,018 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448030017"},{"qualifier":"state_0002","vlen":6,"tag":[],"timestamp":"1689448030017"}]},"ts":"1689448030017"} 2023-07-15 19:07:10,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=189, resume processing ppid=186 2023-07-15 19:07:10,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=189, ppid=186, state=SUCCESS; CloseRegionProcedure 3b01706d08a57198ac1f922201f72811, server=jenkins-hbase4.apache.org,42361,1689447991925 in 172 msec 2023-07-15 19:07:10,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=192, resume processing ppid=185 2023-07-15 19:07:10,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=192, ppid=185, state=SUCCESS; CloseRegionProcedure 4814b2c3e764165368b352d42887446c, server=jenkins-hbase4.apache.org,42217,1689447992037 in 166 msec 2023-07-15 19:07:10,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=191, resume processing ppid=183 2023-07-15 19:07:10,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=191, ppid=183, state=SUCCESS; CloseRegionProcedure 92b70f6d151941fd1db7b5555e62dbff, server=jenkins-hbase4.apache.org,36223,1689447992001 in 174 msec 2023-07-15 19:07:10,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=185, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=4814b2c3e764165368b352d42887446c, UNASSIGN in 182 msec 2023-07-15 19:07:10,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=186, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=3b01706d08a57198ac1f922201f72811, UNASSIGN in 182 msec 2023-07-15 19:07:10,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=183, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=92b70f6d151941fd1db7b5555e62dbff, UNASSIGN in 183 msec 2023-07-15 19:07:10,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=26 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/.tmp/f/602256b53aa54db6bc4ca4a9a6f2c7b2 2023-07-15 19:07:10,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=26 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/.tmp/f/0559c25c1d8e4097beaf2ddc7e3e18ef 2023-07-15 19:07:10,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=26 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/.tmp/f/a0f5f83e2d4c429bb5d8ae99ccea5460 2023-07-15 19:07:10,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/.tmp/f/0559c25c1d8e4097beaf2ddc7e3e18ef as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f/0559c25c1d8e4097beaf2ddc7e3e18ef 2023-07-15 19:07:10,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/.tmp/f/602256b53aa54db6bc4ca4a9a6f2c7b2 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f/602256b53aa54db6bc4ca4a9a6f2c7b2 2023-07-15 19:07:10,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/.tmp/f/a0f5f83e2d4c429bb5d8ae99ccea5460 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f/a0f5f83e2d4c429bb5d8ae99ccea5460 2023-07-15 19:07:10,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f/0559c25c1d8e4097beaf2ddc7e3e18ef, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 19:07:10,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~26 B/26, heapSize ~344 B/344, currentSize=0 B/0 for 71ec91d4744bf2d970141091f4a1cca3 in 50ms, sequenceid=5, compaction requested=false 2023-07-15 19:07:10,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f/a0f5f83e2d4c429bb5d8ae99ccea5460, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 19:07:10,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~26 B/26, heapSize ~344 B/344, currentSize=0 B/0 for 7e496e21c7d001317d5cf585a8130f26 in 51ms, sequenceid=5, compaction requested=false 2023-07-15 19:07:10,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f/602256b53aa54db6bc4ca4a9a6f2c7b2, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 19:07:10,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~26 B/26, heapSize ~344 B/344, currentSize=0 B/0 for 577e272d9eea3fb0c7b6721baf1c28f8 in 57ms, sequenceid=5, compaction requested=false 2023-07-15 19:07:10,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 19:07:10,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 19:07:10,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 19:07:10,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26. 2023-07-15 19:07:10,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7e496e21c7d001317d5cf585a8130f26: 2023-07-15 19:07:10,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3. 2023-07-15 19:07:10,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 71ec91d4744bf2d970141091f4a1cca3: 2023-07-15 19:07:10,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8. 2023-07-15 19:07:10,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 577e272d9eea3fb0c7b6721baf1c28f8: 2023-07-15 19:07:10,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:07:10,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:07:10,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:07:10,084 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=181 updating hbase:meta row=577e272d9eea3fb0c7b6721baf1c28f8, regionState=CLOSED 2023-07-15 19:07:10,084 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=178 updating hbase:meta row=71ec91d4744bf2d970141091f4a1cca3, regionState=CLOSED 2023-07-15 19:07:10,084 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=184 updating hbase:meta row=7e496e21c7d001317d5cf585a8130f26, regionState=CLOSED 2023-07-15 19:07:10,084 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448030084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448030084"}]},"ts":"1689448030084"} 2023-07-15 19:07:10,084 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689448030084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448030084"}]},"ts":"1689448030084"} 2023-07-15 19:07:10,085 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":"1689448030084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448030084"}]},"ts":"1689448030084"} 2023-07-15 19:07:10,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=177 2023-07-15 19:07:10,088 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=188, resume processing ppid=181 2023-07-15 19:07:10,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=193, resume processing ppid=184 2023-07-15 19:07:10,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=187, resume processing ppid=178 2023-07-15 19:07:10,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=193, ppid=184, state=SUCCESS; CloseRegionProcedure 7e496e21c7d001317d5cf585a8130f26, server=jenkins-hbase4.apache.org,36223,1689447992001 in 235 msec 2023-07-15 19:07:10,088 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=188, ppid=181, state=SUCCESS; CloseRegionProcedure 577e272d9eea3fb0c7b6721baf1c28f8, server=jenkins-hbase4.apache.org,42217,1689447992037 in 242 msec 2023-07-15 19:07:10,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=187, ppid=178, state=SUCCESS; CloseRegionProcedure 71ec91d4744bf2d970141091f4a1cca3, server=jenkins-hbase4.apache.org,42361,1689447991925 in 244 msec 2023-07-15 19:07:10,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=181, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=577e272d9eea3fb0c7b6721baf1c28f8, UNASSIGN in 250 msec 2023-07-15 19:07:10,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=184, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=7e496e21c7d001317d5cf585a8130f26, UNASSIGN in 250 msec 2023-07-15 19:07:10,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=178, resume processing ppid=177 2023-07-15 19:07:10,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=178, ppid=177, state=SUCCESS; TransitRegionStateProcedure table=testSplitAndMergeWithReplicaTable, region=71ec91d4744bf2d970141091f4a1cca3, UNASSIGN in 250 msec 2023-07-15 19:07:10,090 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448030090"}]},"ts":"1689448030090"} 2023-07-15 19:07:10,091 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitAndMergeWithReplicaTable, state=DISABLED in hbase:meta 2023-07-15 19:07:10,098 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testSplitAndMergeWithReplicaTable to state=DISABLED 2023-07-15 19:07:10,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=177, state=SUCCESS; DisableTableProcedure table=testSplitAndMergeWithReplicaTable in 267 msec 2023-07-15 19:07:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=177 2023-07-15 19:07:10,588 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testSplitAndMergeWithReplicaTable, procId: 177 completed 2023-07-15 19:07:10,589 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testSplitAndMergeWithReplicaTable 2023-07-15 19:07:10,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=196, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSplitAndMergeWithReplicaTable 2023-07-15 19:07:10,593 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=196, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testSplitAndMergeWithReplicaTable 2023-07-15 19:07:10,594 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=196, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testSplitAndMergeWithReplicaTable 2023-07-15 19:07:10,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=196 2023-07-15 19:07:10,604 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:07:10,604 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:07:10,604 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:07:10,608 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/recovered.edits] 2023-07-15 19:07:10,608 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/recovered.edits] 2023-07-15 19:07:10,608 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/recovered.edits] 2023-07-15 19:07:10,617 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f/0559c25c1d8e4097beaf2ddc7e3e18ef to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/f/0559c25c1d8e4097beaf2ddc7e3e18ef 2023-07-15 19:07:10,618 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f/a0f5f83e2d4c429bb5d8ae99ccea5460 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/f/a0f5f83e2d4c429bb5d8ae99ccea5460 2023-07-15 19:07:10,619 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f/602256b53aa54db6bc4ca4a9a6f2c7b2 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/f/602256b53aa54db6bc4ca4a9a6f2c7b2 2023-07-15 19:07:10,625 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/recovered.edits/8.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26/recovered.edits/8.seqid 2023-07-15 19:07:10,626 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/recovered.edits/8.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3/recovered.edits/8.seqid 2023-07-15 19:07:10,626 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/7e496e21c7d001317d5cf585a8130f26 2023-07-15 19:07:10,627 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/71ec91d4744bf2d970141091f4a1cca3 2023-07-15 19:07:10,627 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/recovered.edits/8.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8/recovered.edits/8.seqid 2023-07-15 19:07:10,628 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testSplitAndMergeWithReplicaTable/577e272d9eea3fb0c7b6721baf1c28f8 2023-07-15 19:07:10,628 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testSplitAndMergeWithReplicaTable regions 2023-07-15 19:07:10,631 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=196, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testSplitAndMergeWithReplicaTable 2023-07-15 19:07:10,634 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testSplitAndMergeWithReplicaTable from hbase:meta 2023-07-15 19:07:10,641 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testSplitAndMergeWithReplicaTable' descriptor. 2023-07-15 19:07:10,642 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=196, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testSplitAndMergeWithReplicaTable 2023-07-15 19:07:10,642 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testSplitAndMergeWithReplicaTable' from region states. 2023-07-15 19:07:10,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,643 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,643 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,643 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,643 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448030642"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,648 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 9 regions from META 2023-07-15 19:07:10,649 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 71ec91d4744bf2d970141091f4a1cca3, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702.71ec91d4744bf2d970141091f4a1cca3.', STARTKEY => '', ENDKEY => '4'}, {ENCODED => 444ed713f9dba45050a25f589f763038, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702_0001.444ed713f9dba45050a25f589f763038.', STARTKEY => '', ENDKEY => '4', REPLICA_ID => 1}, {ENCODED => 9b2377074d2f148303e8254e6335df64, NAME => 'testSplitAndMergeWithReplicaTable,,1689448018702_0002.9b2377074d2f148303e8254e6335df64.', STARTKEY => '', ENDKEY => '4', REPLICA_ID => 2}, {ENCODED => 577e272d9eea3fb0c7b6721baf1c28f8, NAME => 'testSplitAndMergeWithReplicaTable,4,1689448018702.577e272d9eea3fb0c7b6721baf1c28f8.', STARTKEY => '4', ENDKEY => '7'}, {ENCODED => 7ac5281096e622acd7d0636cab3f2580, NAME => 'testSplitAndMergeWithReplicaTable,4,1689448018702_0001.7ac5281096e622acd7d0636cab3f2580.', STARTKEY => '4', ENDKEY => '7', REPLICA_ID => 1}, {ENCODED => 92b70f6d151941fd1db7b5555e62dbff, NAME => 'testSplitAndMergeWithReplicaTable,4,1689448018702_0002.92b70f6d151941fd1db7b5555e62dbff.', STARTKEY => '4', ENDKEY => '7', REPLICA_ID => 2}, {ENCODED => 7e496e21c7d001317d5cf585a8130f26, NAME => 'testSplitAndMergeWithReplicaTable,7,1689448018702.7e496e21c7d001317d5cf585a8130f26.', STARTKEY => '7', ENDKEY => ''}, {ENCODED => 4814b2c3e764165368b352d42887446c, NAME => 'testSplitAndMergeWithReplicaTable,7,1689448018702_0001.4814b2c3e764165368b352d42887446c.', STARTKEY => '7', ENDKEY => '', REPLICA_ID => 1}, {ENCODED => 3b01706d08a57198ac1f922201f72811, NAME => 'testSplitAndMergeWithReplicaTable,7,1689448018702_0002.3b01706d08a57198ac1f922201f72811.', STARTKEY => '7', ENDKEY => '', REPLICA_ID => 2}] 2023-07-15 19:07:10,649 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testSplitAndMergeWithReplicaTable' as deleted. 2023-07-15 19:07:10,649 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitAndMergeWithReplicaTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448030649"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:10,665 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testSplitAndMergeWithReplicaTable state from META 2023-07-15 19:07:10,668 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=196, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testSplitAndMergeWithReplicaTable 2023-07-15 19:07:10,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=196, state=SUCCESS; DeleteTableProcedure table=testSplitAndMergeWithReplicaTable in 79 msec 2023-07-15 19:07:10,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=196 2023-07-15 19:07:10,846 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testSplitAndMergeWithReplicaTable, procId: 196 completed 2023-07-15 19:07:10,872 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testSplitAndMergeWithReplicaTable Thread=611 (was 625), OpenFileDescriptor=729 (was 740), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 223), ProcessCount=169 (was 170), AvailableMemoryMB=5254 (was 5261) 2023-07-15 19:07:10,872 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=611 is superior to 500 2023-07-15 19:07:10,893 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testMergeRegions Thread=611, OpenFileDescriptor=729, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=169, AvailableMemoryMB=5253 2023-07-15 19:07:10,893 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=611 is superior to 500 2023-07-15 19:07:10,895 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMergeRegions', {NAME => 'd', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 19:07:10,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=197, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMergeRegions 2023-07-15 19:07:10,899 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=197, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMergeRegions execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:07:10,899 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMergeRegions" procId is: 197 2023-07-15 19:07:10,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=197 2023-07-15 19:07:10,903 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=197, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMergeRegions execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:07:10,906 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:10,906 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:10,906 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:10,907 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104 empty. 2023-07-15 19:07:10,908 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894 empty. 2023-07-15 19:07:10,908 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4 empty. 2023-07-15 19:07:10,908 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:10,909 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:10,909 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:10,909 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMergeRegions regions 2023-07-15 19:07:10,926 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/.tabledesc/.tableinfo.0000000001 2023-07-15 19:07:10,928 INFO [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(7675): creating {ENCODED => e47501e6dd46c60a109edb1ec7620104, NAME => 'testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.', STARTKEY => '', ENDKEY => '3'}, tableDescriptor='testMergeRegions', {NAME => 'd', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:07:10,929 INFO [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(7675): creating {ENCODED => a7f601eff0d1b72e7d1bc32d59255894, NAME => 'testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.', STARTKEY => '6', ENDKEY => ''}, tableDescriptor='testMergeRegions', {NAME => 'd', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:07:10,929 INFO [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8d413dd2e15b8ab9626760899fc35cb4, NAME => 'testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.', STARTKEY => '3', ENDKEY => '6'}, tableDescriptor='testMergeRegions', {NAME => 'd', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:07:10,963 DEBUG [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(866): Instantiated testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:10,963 DEBUG [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(1604): Closing 8d413dd2e15b8ab9626760899fc35cb4, disabling compactions & flushes 2023-07-15 19:07:10,963 INFO [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(1626): Closing region testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:10,963 DEBUG [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:10,963 DEBUG [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(1714): Acquired close lock on testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. after waiting 0 ms 2023-07-15 19:07:10,963 DEBUG [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(1724): Updates disabled for region testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:10,964 INFO [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(1838): Closed testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:10,964 DEBUG [RegionOpenAndInit-testMergeRegions-pool-1] regionserver.HRegion(1558): Region close journal for 8d413dd2e15b8ab9626760899fc35cb4: 2023-07-15 19:07:10,964 DEBUG [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(866): Instantiated testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:10,964 DEBUG [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(1604): Closing e47501e6dd46c60a109edb1ec7620104, disabling compactions & flushes 2023-07-15 19:07:10,964 INFO [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(1626): Closing region testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:10,964 DEBUG [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:10,964 DEBUG [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. after waiting 0 ms 2023-07-15 19:07:10,964 DEBUG [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:10,964 INFO [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(1838): Closed testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:10,964 DEBUG [RegionOpenAndInit-testMergeRegions-pool-0] regionserver.HRegion(1558): Region close journal for e47501e6dd46c60a109edb1ec7620104: 2023-07-15 19:07:10,967 DEBUG [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(866): Instantiated testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:10,967 DEBUG [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(1604): Closing a7f601eff0d1b72e7d1bc32d59255894, disabling compactions & flushes 2023-07-15 19:07:10,967 INFO [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(1626): Closing region testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:10,967 DEBUG [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:10,967 DEBUG [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(1714): Acquired close lock on testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. after waiting 0 ms 2023-07-15 19:07:10,967 DEBUG [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(1724): Updates disabled for region testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:10,968 INFO [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(1838): Closed testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:10,968 DEBUG [RegionOpenAndInit-testMergeRegions-pool-2] regionserver.HRegion(1558): Region close journal for a7f601eff0d1b72e7d1bc32d59255894: 2023-07-15 19:07:10,972 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=197, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMergeRegions execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:07:10,973 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448030973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448030973"}]},"ts":"1689448030973"} 2023-07-15 19:07:10,974 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448030973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448030973"}]},"ts":"1689448030973"} 2023-07-15 19:07:10,974 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448030973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448030973"}]},"ts":"1689448030973"} 2023-07-15 19:07:10,975 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-15 19:07:10,976 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=197, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMergeRegions execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:07:10,976 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMergeRegions","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448030976"}]},"ts":"1689448030976"} 2023-07-15 19:07:10,977 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMergeRegions, state=ENABLING in hbase:meta 2023-07-15 19:07:10,980 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:07:10,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:07:10,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:07:10,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:07:10,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:07:10,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=198, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104, ASSIGN}, {pid=199, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4, ASSIGN}, {pid=200, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=a7f601eff0d1b72e7d1bc32d59255894, ASSIGN}] 2023-07-15 19:07:10,986 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=198, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104, ASSIGN 2023-07-15 19:07:10,987 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=199, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4, ASSIGN 2023-07-15 19:07:10,987 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=200, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=a7f601eff0d1b72e7d1bc32d59255894, ASSIGN 2023-07-15 19:07:10,988 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=198, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:07:10,988 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=200, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMergeRegions, region=a7f601eff0d1b72e7d1bc32d59255894, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:07:10,988 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=199, ppid=197, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:07:11,138 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 3 regions. 3 retained the pre-restart assignment. 2023-07-15 19:07:11,142 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=198 updating hbase:meta row=e47501e6dd46c60a109edb1ec7620104, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:11,142 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=199 updating hbase:meta row=8d413dd2e15b8ab9626760899fc35cb4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:11,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=200 updating hbase:meta row=a7f601eff0d1b72e7d1bc32d59255894, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:11,143 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448031142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448031142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448031142"}]},"ts":"1689448031142"} 2023-07-15 19:07:11,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448031142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448031142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448031142"}]},"ts":"1689448031142"} 2023-07-15 19:07:11,143 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448031142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448031142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448031142"}]},"ts":"1689448031142"} 2023-07-15 19:07:11,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=201, ppid=198, state=RUNNABLE; OpenRegionProcedure e47501e6dd46c60a109edb1ec7620104, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:11,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=203, ppid=200, state=RUNNABLE; OpenRegionProcedure a7f601eff0d1b72e7d1bc32d59255894, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:07:11,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=202, ppid=199, state=RUNNABLE; OpenRegionProcedure 8d413dd2e15b8ab9626760899fc35cb4, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:07:11,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=197 2023-07-15 19:07:11,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:11,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:11,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d413dd2e15b8ab9626760899fc35cb4, NAME => 'testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.', STARTKEY => '3', ENDKEY => '6'} 2023-07-15 19:07:11,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7f601eff0d1b72e7d1bc32d59255894, NAME => 'testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.', STARTKEY => '6', ENDKEY => ''} 2023-07-15 19:07:11,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMergeRegions 8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMergeRegions a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:11,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:11,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:11,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e47501e6dd46c60a109edb1ec7620104, NAME => 'testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.', STARTKEY => '', ENDKEY => '3'} 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMergeRegions e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,306 INFO [StoreOpener-a7f601eff0d1b72e7d1bc32d59255894-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family d of region a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:11,307 INFO [StoreOpener-8d413dd2e15b8ab9626760899fc35cb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family d of region 8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,308 DEBUG [StoreOpener-a7f601eff0d1b72e7d1bc32d59255894-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894/d 2023-07-15 19:07:11,308 DEBUG [StoreOpener-a7f601eff0d1b72e7d1bc32d59255894-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894/d 2023-07-15 19:07:11,308 INFO [StoreOpener-a7f601eff0d1b72e7d1bc32d59255894-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7f601eff0d1b72e7d1bc32d59255894 columnFamilyName d 2023-07-15 19:07:11,311 INFO [StoreOpener-a7f601eff0d1b72e7d1bc32d59255894-1] regionserver.HStore(310): Store=a7f601eff0d1b72e7d1bc32d59255894/d, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:11,315 INFO [StoreOpener-e47501e6dd46c60a109edb1ec7620104-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family d of region e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:11,316 DEBUG [StoreOpener-8d413dd2e15b8ab9626760899fc35cb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4/d 2023-07-15 19:07:11,316 DEBUG [StoreOpener-8d413dd2e15b8ab9626760899fc35cb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4/d 2023-07-15 19:07:11,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:11,316 INFO [StoreOpener-8d413dd2e15b8ab9626760899fc35cb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d413dd2e15b8ab9626760899fc35cb4 columnFamilyName d 2023-07-15 19:07:11,316 DEBUG [StoreOpener-e47501e6dd46c60a109edb1ec7620104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104/d 2023-07-15 19:07:11,316 DEBUG [StoreOpener-e47501e6dd46c60a109edb1ec7620104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104/d 2023-07-15 19:07:11,316 INFO [StoreOpener-8d413dd2e15b8ab9626760899fc35cb4-1] regionserver.HStore(310): Store=8d413dd2e15b8ab9626760899fc35cb4/d, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:11,316 INFO [StoreOpener-e47501e6dd46c60a109edb1ec7620104-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e47501e6dd46c60a109edb1ec7620104 columnFamilyName d 2023-07-15 19:07:11,317 INFO [StoreOpener-e47501e6dd46c60a109edb1ec7620104-1] regionserver.HStore(310): Store=e47501e6dd46c60a109edb1ec7620104/d, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:11,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:11,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:07:11,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7f601eff0d1b72e7d1bc32d59255894; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67142858, jitterRate=5.065500736236572E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:07:11,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7f601eff0d1b72e7d1bc32d59255894: 2023-07-15 19:07:11,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894., pid=203, masterSystemTime=1689448031299 2023-07-15 19:07:11,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:07:11,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e47501e6dd46c60a109edb1ec7620104; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60853179, jitterRate=-0.09321697056293488}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:07:11,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e47501e6dd46c60a109edb1ec7620104: 2023-07-15 19:07:11,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104., pid=201, masterSystemTime=1689448031299 2023-07-15 19:07:11,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:07:11,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8d413dd2e15b8ab9626760899fc35cb4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60750437, jitterRate=-0.09474794566631317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:07:11,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8d413dd2e15b8ab9626760899fc35cb4: 2023-07-15 19:07:11,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4., pid=202, masterSystemTime=1689448031299 2023-07-15 19:07:11,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:11,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:11,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:11,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:11,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:11,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:11,331 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=198 updating hbase:meta row=e47501e6dd46c60a109edb1ec7620104, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:11,331 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=200 updating hbase:meta row=a7f601eff0d1b72e7d1bc32d59255894, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:11,331 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=199 updating hbase:meta row=8d413dd2e15b8ab9626760899fc35cb4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:11,331 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448031331"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448031331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448031331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448031331"}]},"ts":"1689448031331"} 2023-07-15 19:07:11,331 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448031331"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448031331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448031331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448031331"}]},"ts":"1689448031331"} 2023-07-15 19:07:11,332 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448031331"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448031331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448031331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448031331"}]},"ts":"1689448031331"} 2023-07-15 19:07:11,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=202, resume processing ppid=199 2023-07-15 19:07:11,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=203, resume processing ppid=200 2023-07-15 19:07:11,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=202, ppid=199, state=SUCCESS; OpenRegionProcedure 8d413dd2e15b8ab9626760899fc35cb4, server=jenkins-hbase4.apache.org,36223,1689447992001 in 189 msec 2023-07-15 19:07:11,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=203, ppid=200, state=SUCCESS; OpenRegionProcedure a7f601eff0d1b72e7d1bc32d59255894, server=jenkins-hbase4.apache.org,42361,1689447991925 in 189 msec 2023-07-15 19:07:11,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=201, resume processing ppid=198 2023-07-15 19:07:11,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=201, ppid=198, state=SUCCESS; OpenRegionProcedure e47501e6dd46c60a109edb1ec7620104, server=jenkins-hbase4.apache.org,42217,1689447992037 in 189 msec 2023-07-15 19:07:11,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=198, ppid=197, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104, ASSIGN in 354 msec 2023-07-15 19:07:11,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=200, ppid=197, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=a7f601eff0d1b72e7d1bc32d59255894, ASSIGN in 354 msec 2023-07-15 19:07:11,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=199, resume processing ppid=197 2023-07-15 19:07:11,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=199, ppid=197, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4, ASSIGN in 354 msec 2023-07-15 19:07:11,339 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=197, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMergeRegions execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:07:11,339 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMergeRegions","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448031339"}]},"ts":"1689448031339"} 2023-07-15 19:07:11,341 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMergeRegions, state=ENABLED in hbase:meta 2023-07-15 19:07:11,343 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=197, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMergeRegions execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:07:11,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=197, state=SUCCESS; CreateTableProcedure table=testMergeRegions in 448 msec 2023-07-15 19:07:11,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=197 2023-07-15 19:07:11,654 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMergeRegions, procId: 197 completed 2023-07-15 19:07:11,654 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testMergeRegions get assigned. Timeout = 60000ms 2023-07-15 19:07:11,655 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:07:11,658 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=27,queue=1,port=42361] regionserver.StoreScanner(1093): Switch to stream read (scanned=32836 bytes) of info 2023-07-15 19:07:11,661 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testMergeRegions assigned to meta. Checking AM states. 2023-07-15 19:07:11,661 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:07:11,661 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testMergeRegions assigned. 2023-07-15 19:07:11,662 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:07:11,676 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions e47501e6dd46c60a109edb1ec7620104, 8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=204, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testMergeRegions, regions=[e47501e6dd46c60a109edb1ec7620104, 8d413dd2e15b8ab9626760899fc35cb4], force=false 2023-07-15 19:07:11,686 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=204, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testMergeRegions, regions=[e47501e6dd46c60a109edb1ec7620104, 8d413dd2e15b8ab9626760899fc35cb4], force=false 2023-07-15 19:07:11,686 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=204, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testMergeRegions, regions=[e47501e6dd46c60a109edb1ec7620104, 8d413dd2e15b8ab9626760899fc35cb4], force=false 2023-07-15 19:07:11,686 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=204, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testMergeRegions, regions=[e47501e6dd46c60a109edb1ec7620104, 8d413dd2e15b8ab9626760899fc35cb4], force=false 2023-07-15 19:07:11,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=204 2023-07-15 19:07:11,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=205, ppid=204, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104, UNASSIGN}, {pid=206, ppid=204, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4, UNASSIGN}] 2023-07-15 19:07:11,694 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=205, ppid=204, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104, UNASSIGN 2023-07-15 19:07:11,694 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=206, ppid=204, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4, UNASSIGN 2023-07-15 19:07:11,695 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=205 updating hbase:meta row=e47501e6dd46c60a109edb1ec7620104, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:11,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=206 updating hbase:meta row=8d413dd2e15b8ab9626760899fc35cb4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:11,695 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448031695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448031695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448031695"}]},"ts":"1689448031695"} 2023-07-15 19:07:11,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448031695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448031695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448031695"}]},"ts":"1689448031695"} 2023-07-15 19:07:11,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=207, ppid=205, state=RUNNABLE; CloseRegionProcedure e47501e6dd46c60a109edb1ec7620104, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:11,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=208, ppid=206, state=RUNNABLE; CloseRegionProcedure 8d413dd2e15b8ab9626760899fc35cb4, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:07:11,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8d413dd2e15b8ab9626760899fc35cb4, disabling compactions & flushes 2023-07-15 19:07:11,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:11,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:11,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. after waiting 0 ms 2023-07-15 19:07:11,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:11,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e47501e6dd46c60a109edb1ec7620104, disabling compactions & flushes 2023-07-15 19:07:11,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:11,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:11,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. after waiting 0 ms 2023-07-15 19:07:11,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:11,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-15 19:07:11,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-15 19:07:11,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:11,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8d413dd2e15b8ab9626760899fc35cb4: 2023-07-15 19:07:11,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:11,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e47501e6dd46c60a109edb1ec7620104: 2023-07-15 19:07:11,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:11,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:11,866 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=206 updating hbase:meta row=8d413dd2e15b8ab9626760899fc35cb4, regionState=CLOSED 2023-07-15 19:07:11,866 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=205 updating hbase:meta row=e47501e6dd46c60a109edb1ec7620104, regionState=CLOSED 2023-07-15 19:07:11,866 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":52,"tag":[],"timestamp":"1689448031866"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448031866"}]},"ts":"1689448031866"} 2023-07-15 19:07:11,866 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448031866"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448031866"}]},"ts":"1689448031866"} 2023-07-15 19:07:11,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=208, resume processing ppid=206 2023-07-15 19:07:11,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=208, ppid=206, state=SUCCESS; CloseRegionProcedure 8d413dd2e15b8ab9626760899fc35cb4, server=jenkins-hbase4.apache.org,36223,1689447992001 in 171 msec 2023-07-15 19:07:11,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=207, resume processing ppid=205 2023-07-15 19:07:11,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=207, ppid=205, state=SUCCESS; CloseRegionProcedure e47501e6dd46c60a109edb1ec7620104, server=jenkins-hbase4.apache.org,42217,1689447992037 in 171 msec 2023-07-15 19:07:11,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=206, ppid=204, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4, UNASSIGN in 183 msec 2023-07-15 19:07:11,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=205, resume processing ppid=204 2023-07-15 19:07:11,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=205, ppid=204, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104, UNASSIGN in 184 msec 2023-07-15 19:07:11,901 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=-1 2023-07-15 19:07:11,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:11,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:11,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":51,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":52,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:11,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=209, ppid=204, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=0328fb0cfe10f794dbb42eaecad28c56, ASSIGN}] 2023-07-15 19:07:11,907 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=209, ppid=204, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=0328fb0cfe10f794dbb42eaecad28c56, ASSIGN 2023-07-15 19:07:11,908 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=209, ppid=204, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMergeRegions, region=0328fb0cfe10f794dbb42eaecad28c56, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:07:11,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=204 2023-07-15 19:07:12,058 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:07:12,058 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=209 updating hbase:meta row=0328fb0cfe10f794dbb42eaecad28c56, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:12,059 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448032058"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448032058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448032058"}]},"ts":"1689448032058"} 2023-07-15 19:07:12,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=210, ppid=209, state=RUNNABLE; OpenRegionProcedure 0328fb0cfe10f794dbb42eaecad28c56, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:12,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56. 2023-07-15 19:07:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0328fb0cfe10f794dbb42eaecad28c56, NAME => 'testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.', STARTKEY => '', ENDKEY => '6'} 2023-07-15 19:07:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMergeRegions 0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,217 WARN [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(955): .regioninfo file not found for region: 0328fb0cfe10f794dbb42eaecad28c56 on table testMergeRegions 2023-07-15 19:07:12,228 INFO [StoreOpener-0328fb0cfe10f794dbb42eaecad28c56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family d of region 0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,230 DEBUG [StoreOpener-0328fb0cfe10f794dbb42eaecad28c56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56/d 2023-07-15 19:07:12,230 DEBUG [StoreOpener-0328fb0cfe10f794dbb42eaecad28c56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56/d 2023-07-15 19:07:12,230 INFO [StoreOpener-0328fb0cfe10f794dbb42eaecad28c56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0328fb0cfe10f794dbb42eaecad28c56 columnFamilyName d 2023-07-15 19:07:12,231 INFO [StoreOpener-0328fb0cfe10f794dbb42eaecad28c56-1] regionserver.HStore(310): Store=0328fb0cfe10f794dbb42eaecad28c56/d, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:12,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0328fb0cfe10f794dbb42eaecad28c56; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64877417, jitterRate=-0.03325115144252777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:07:12,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0328fb0cfe10f794dbb42eaecad28c56: 2023-07-15 19:07:12,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56., pid=210, masterSystemTime=1689448032212 2023-07-15 19:07:12,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56. 2023-07-15 19:07:12,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56. 2023-07-15 19:07:12,242 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=209 updating hbase:meta row=0328fb0cfe10f794dbb42eaecad28c56, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:12,243 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448032242"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448032242"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448032242"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448032242"}]},"ts":"1689448032242"} 2023-07-15 19:07:12,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=210, resume processing ppid=209 2023-07-15 19:07:12,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=210, ppid=209, state=SUCCESS; OpenRegionProcedure 0328fb0cfe10f794dbb42eaecad28c56, server=jenkins-hbase4.apache.org,42217,1689447992037 in 187 msec 2023-07-15 19:07:12,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=209, resume processing ppid=204 2023-07-15 19:07:12,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=209, ppid=204, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=0328fb0cfe10f794dbb42eaecad28c56, ASSIGN in 345 msec 2023-07-15 19:07:12,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=204, state=SUCCESS; MergeTableRegionsProcedure table=testMergeRegions, regions=[e47501e6dd46c60a109edb1ec7620104, 8d413dd2e15b8ab9626760899fc35cb4], force=false in 574 msec 2023-07-15 19:07:12,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=204 2023-07-15 19:07:12,441 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testMergeRegions, procId: 204 completed 2023-07-15 19:07:12,448 DEBUG [Listener at localhost/45529] janitor.CatalogJanitor(175): 2023-07-15 19:07:12,449 DEBUG [Listener at localhost/45529] janitor.CatalogJanitor(255): Cleaning merged region {ENCODED => 0328fb0cfe10f794dbb42eaecad28c56, NAME => 'testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.', STARTKEY => '', ENDKEY => '6'} 2023-07-15 19:07:12,451 DEBUG [Listener at localhost/45529] janitor.CatalogJanitor(263): Deleting parents ([e47501e6dd46c60a109edb1ec7620104], [8d413dd2e15b8ab9626760899fc35cb4]) from fs; merged child {ENCODED => 0328fb0cfe10f794dbb42eaecad28c56, NAME => 'testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.', STARTKEY => '', ENDKEY => '6'} no longer holds references 2023-07-15 19:07:12,464 DEBUG [Listener at localhost/45529] procedure2.ProcedureExecutor(1029): Stored pid=211, state=RUNNABLE:GC_MERGED_REGIONS_PREPARE; GCMultipleMergedRegionsProcedure child=0328fb0cfe10f794dbb42eaecad28c56, parents:[e47501e6dd46c60a109edb1ec7620104], [8d413dd2e15b8ab9626760899fc35cb4] 2023-07-15 19:07:12,466 DEBUG [Listener at localhost/45529] janitor.CatalogJanitor(274): Submitted procedure pid=211, state=RUNNABLE:GC_MERGED_REGIONS_PREPARE; GCMultipleMergedRegionsProcedure child=0328fb0cfe10f794dbb42eaecad28c56, parents:[e47501e6dd46c60a109edb1ec7620104], [8d413dd2e15b8ab9626760899fc35cb4] for merged region {ENCODED => 0328fb0cfe10f794dbb42eaecad28c56, NAME => 'testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.', STARTKEY => '', ENDKEY => '6'} 2023-07-15 19:07:12,466 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=211, state=RUNNABLE:GC_MERGED_REGIONS_PREPARE; GCMultipleMergedRegionsProcedure child=0328fb0cfe10f794dbb42eaecad28c56, parents:[e47501e6dd46c60a109edb1ec7620104], [8d413dd2e15b8ab9626760899fc35cb4] 2023-07-15 19:07:12,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=212, ppid=211, state=RUNNABLE:GC_REGION_PREPARE; GCRegionProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104}, {pid=213, ppid=211, state=RUNNABLE:GC_REGION_PREPARE; GCRegionProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4}] 2023-07-15 19:07:12,480 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=212, ppid=211, state=RUNNABLE:GC_REGION_PREPARE; GCRegionProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:12,481 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=213, ppid=211, state=RUNNABLE:GC_REGION_PREPARE; GCRegionProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:12,483 DEBUG [PEWorker-3] assignment.GCRegionProcedure(88): Archiving region=e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:12,483 DEBUG [PEWorker-5] assignment.GCRegionProcedure(88): Archiving region=8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:12,483 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:12,483 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:12,485 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4/d, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4/recovered.edits] 2023-07-15 19:07:12,485 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104/d, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104/recovered.edits] 2023-07-15 19:07:12,491 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4/recovered.edits/4.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4/recovered.edits/4.seqid 2023-07-15 19:07:12,493 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104/recovered.edits/4.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104/recovered.edits/4.seqid 2023-07-15 19:07:12,493 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/8d413dd2e15b8ab9626760899fc35cb4 2023-07-15 19:07:12,493 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/e47501e6dd46c60a109edb1ec7620104 2023-07-15 19:07:12,495 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:12,495 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:12,497 INFO [PEWorker-5] hbase.MetaTableAccessor(1761): Deleted testMergeRegions,3,1689448030895.8d413dd2e15b8ab9626760899fc35cb4. 2023-07-15 19:07:12,497 INFO [PEWorker-3] hbase.MetaTableAccessor(1761): Deleted testMergeRegions,,1689448030895.e47501e6dd46c60a109edb1ec7620104. 2023-07-15 19:07:12,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=213, ppid=211, state=SUCCESS; GCRegionProcedure table=testMergeRegions, region=8d413dd2e15b8ab9626760899fc35cb4 in 27 msec 2023-07-15 19:07:12,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=212, resume processing ppid=211 2023-07-15 19:07:12,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=212, ppid=211, state=SUCCESS; GCRegionProcedure table=testMergeRegions, region=e47501e6dd46c60a109edb1ec7620104 in 27 msec 2023-07-15 19:07:12,500 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":2,"row":"testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.","families":{"info":[{"qualifier":"merge0000","vlen":0,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:12,501 INFO [PEWorker-2] hbase.MetaTableAccessor(1847): Deleted merge references in testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56., deleted qualifiers merge0000, merge0001 2023-07-15 19:07:12,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=211, state=SUCCESS; GCMultipleMergedRegionsProcedure child=0328fb0cfe10f794dbb42eaecad28c56, parents:[e47501e6dd46c60a109edb1ec7620104], [8d413dd2e15b8ab9626760899fc35cb4] in 50 msec 2023-07-15 19:07:12,674 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a7f601eff0d1b72e7d1bc32d59255894, 0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=214, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testMergeRegions, regions=[0328fb0cfe10f794dbb42eaecad28c56, a7f601eff0d1b72e7d1bc32d59255894], force=false 2023-07-15 19:07:12,676 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=214, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testMergeRegions, regions=[0328fb0cfe10f794dbb42eaecad28c56, a7f601eff0d1b72e7d1bc32d59255894], force=false 2023-07-15 19:07:12,676 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=214, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testMergeRegions, regions=[0328fb0cfe10f794dbb42eaecad28c56, a7f601eff0d1b72e7d1bc32d59255894], force=false 2023-07-15 19:07:12,676 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=214, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testMergeRegions, regions=[0328fb0cfe10f794dbb42eaecad28c56, a7f601eff0d1b72e7d1bc32d59255894], force=false 2023-07-15 19:07:12,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=214 2023-07-15 19:07:12,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=215, ppid=214, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=0328fb0cfe10f794dbb42eaecad28c56, UNASSIGN}, {pid=216, ppid=214, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=a7f601eff0d1b72e7d1bc32d59255894, UNASSIGN}] 2023-07-15 19:07:12,681 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=215, ppid=214, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=0328fb0cfe10f794dbb42eaecad28c56, UNASSIGN 2023-07-15 19:07:12,681 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=216, ppid=214, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=a7f601eff0d1b72e7d1bc32d59255894, UNASSIGN 2023-07-15 19:07:12,682 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=215 updating hbase:meta row=0328fb0cfe10f794dbb42eaecad28c56, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:12,682 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=216 updating hbase:meta row=a7f601eff0d1b72e7d1bc32d59255894, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:12,682 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448032682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448032682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448032682"}]},"ts":"1689448032682"} 2023-07-15 19:07:12,682 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448032682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448032682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448032682"}]},"ts":"1689448032682"} 2023-07-15 19:07:12,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=217, ppid=216, state=RUNNABLE; CloseRegionProcedure a7f601eff0d1b72e7d1bc32d59255894, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:07:12,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=218, ppid=215, state=RUNNABLE; CloseRegionProcedure 0328fb0cfe10f794dbb42eaecad28c56, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:12,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:12,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7f601eff0d1b72e7d1bc32d59255894, disabling compactions & flushes 2023-07-15 19:07:12,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0328fb0cfe10f794dbb42eaecad28c56, disabling compactions & flushes 2023-07-15 19:07:12,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:12,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56. 2023-07-15 19:07:12,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:12,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56. 2023-07-15 19:07:12,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56. after waiting 0 ms 2023-07-15 19:07:12,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56. 2023-07-15 19:07:12,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. after waiting 0 ms 2023-07-15 19:07:12,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:12,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-15 19:07:12,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-15 19:07:12,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894. 2023-07-15 19:07:12,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7f601eff0d1b72e7d1bc32d59255894: 2023-07-15 19:07:12,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56. 2023-07-15 19:07:12,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0328fb0cfe10f794dbb42eaecad28c56: 2023-07-15 19:07:12,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:12,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:12,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=215 updating hbase:meta row=0328fb0cfe10f794dbb42eaecad28c56, regionState=CLOSED 2023-07-15 19:07:12,851 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=216 updating hbase:meta row=a7f601eff0d1b72e7d1bc32d59255894, regionState=CLOSED 2023-07-15 19:07:12,851 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448032851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448032851"}]},"ts":"1689448032851"} 2023-07-15 19:07:12,851 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1689448032851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448032851"}]},"ts":"1689448032851"} 2023-07-15 19:07:12,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=218, resume processing ppid=215 2023-07-15 19:07:12,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=218, ppid=215, state=SUCCESS; CloseRegionProcedure 0328fb0cfe10f794dbb42eaecad28c56, server=jenkins-hbase4.apache.org,42217,1689447992037 in 169 msec 2023-07-15 19:07:12,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=217, resume processing ppid=216 2023-07-15 19:07:12,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=217, ppid=216, state=SUCCESS; CloseRegionProcedure a7f601eff0d1b72e7d1bc32d59255894, server=jenkins-hbase4.apache.org,42361,1689447991925 in 170 msec 2023-07-15 19:07:12,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=215, ppid=214, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=0328fb0cfe10f794dbb42eaecad28c56, UNASSIGN in 185 msec 2023-07-15 19:07:12,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=216, resume processing ppid=214 2023-07-15 19:07:12,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=216, ppid=214, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=a7f601eff0d1b72e7d1bc32d59255894, UNASSIGN in 187 msec 2023-07-15 19:07:12,891 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=-1 2023-07-15 19:07:12,893 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegions,,1689448030896.0328fb0cfe10f794dbb42eaecad28c56.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:12,893 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegions,6,1689448030895.a7f601eff0d1b72e7d1bc32d59255894.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:12,893 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":51,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":51,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:12,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=219, ppid=214, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=2c2cd0237c10c3b277351a85e30fb8c0, ASSIGN}] 2023-07-15 19:07:12,897 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=219, ppid=214, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMergeRegions, region=2c2cd0237c10c3b277351a85e30fb8c0, ASSIGN 2023-07-15 19:07:12,898 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=219, ppid=214, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMergeRegions, region=2c2cd0237c10c3b277351a85e30fb8c0, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:07:12,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=214 2023-07-15 19:07:13,048 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:07:13,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=219 updating hbase:meta row=2c2cd0237c10c3b277351a85e30fb8c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:13,049 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689448033048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448033048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448033048"}]},"ts":"1689448033048"} 2023-07-15 19:07:13,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=220, ppid=219, state=RUNNABLE; OpenRegionProcedure 2c2cd0237c10c3b277351a85e30fb8c0, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:13,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0. 2023-07-15 19:07:13,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2c2cd0237c10c3b277351a85e30fb8c0, NAME => 'testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:07:13,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMergeRegions 2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:13,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,209 WARN [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(955): .regioninfo file not found for region: 2c2cd0237c10c3b277351a85e30fb8c0 on table testMergeRegions 2023-07-15 19:07:13,228 INFO [StoreOpener-2c2cd0237c10c3b277351a85e30fb8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family d of region 2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,230 DEBUG [StoreOpener-2c2cd0237c10c3b277351a85e30fb8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0/d 2023-07-15 19:07:13,231 DEBUG [StoreOpener-2c2cd0237c10c3b277351a85e30fb8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0/d 2023-07-15 19:07:13,232 INFO [StoreOpener-2c2cd0237c10c3b277351a85e30fb8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c2cd0237c10c3b277351a85e30fb8c0 columnFamilyName d 2023-07-15 19:07:13,232 INFO [StoreOpener-2c2cd0237c10c3b277351a85e30fb8c0-1] regionserver.HStore(310): Store=2c2cd0237c10c3b277351a85e30fb8c0/d, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:13,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2c2cd0237c10c3b277351a85e30fb8c0; next sequenceid=8; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61080214, jitterRate=-0.08983388543128967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:07:13,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2c2cd0237c10c3b277351a85e30fb8c0: 2023-07-15 19:07:13,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0., pid=220, masterSystemTime=1689448033202 2023-07-15 19:07:13,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0. 2023-07-15 19:07:13,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0. 2023-07-15 19:07:13,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=219 updating hbase:meta row=2c2cd0237c10c3b277351a85e30fb8c0, regionState=OPEN, openSeqNum=8, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:13,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689448033244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448033244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448033244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448033244"}]},"ts":"1689448033244"} 2023-07-15 19:07:13,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=220, resume processing ppid=219 2023-07-15 19:07:13,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=220, ppid=219, state=SUCCESS; OpenRegionProcedure 2c2cd0237c10c3b277351a85e30fb8c0, server=jenkins-hbase4.apache.org,42217,1689447992037 in 196 msec 2023-07-15 19:07:13,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=219, resume processing ppid=214 2023-07-15 19:07:13,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=219, ppid=214, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=2c2cd0237c10c3b277351a85e30fb8c0, ASSIGN in 351 msec 2023-07-15 19:07:13,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=214, state=SUCCESS; MergeTableRegionsProcedure table=testMergeRegions, regions=[0328fb0cfe10f794dbb42eaecad28c56, a7f601eff0d1b72e7d1bc32d59255894], force=false in 577 msec 2023-07-15 19:07:13,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=214 2023-07-15 19:07:13,430 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testMergeRegions, procId: 214 completed 2023-07-15 19:07:13,433 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testMergeRegions 2023-07-15 19:07:13,433 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testMergeRegions 2023-07-15 19:07:13,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=221, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testMergeRegions 2023-07-15 19:07:13,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=221 2023-07-15 19:07:13,438 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMergeRegions","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448033438"}]},"ts":"1689448033438"} 2023-07-15 19:07:13,439 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMergeRegions, state=DISABLING in hbase:meta 2023-07-15 19:07:13,441 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testMergeRegions to state=DISABLING 2023-07-15 19:07:13,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=222, ppid=221, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=2c2cd0237c10c3b277351a85e30fb8c0, UNASSIGN}] 2023-07-15 19:07:13,443 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=222, ppid=221, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMergeRegions, region=2c2cd0237c10c3b277351a85e30fb8c0, UNASSIGN 2023-07-15 19:07:13,444 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=222 updating hbase:meta row=2c2cd0237c10c3b277351a85e30fb8c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:13,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689448033444"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448033444"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448033444"}]},"ts":"1689448033444"} 2023-07-15 19:07:13,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=223, ppid=222, state=RUNNABLE; CloseRegionProcedure 2c2cd0237c10c3b277351a85e30fb8c0, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:13,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2c2cd0237c10c3b277351a85e30fb8c0, disabling compactions & flushes 2023-07-15 19:07:13,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0. 2023-07-15 19:07:13,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0. 2023-07-15 19:07:13,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0. after waiting 0 ms 2023-07-15 19:07:13,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0. 2023-07-15 19:07:13,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=7 2023-07-15 19:07:13,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0. 2023-07-15 19:07:13,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2c2cd0237c10c3b277351a85e30fb8c0: 2023-07-15 19:07:13,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,614 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=222 updating hbase:meta row=2c2cd0237c10c3b277351a85e30fb8c0, regionState=CLOSED 2023-07-15 19:07:13,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689448033614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448033614"}]},"ts":"1689448033614"} 2023-07-15 19:07:13,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=223, resume processing ppid=222 2023-07-15 19:07:13,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=223, ppid=222, state=SUCCESS; CloseRegionProcedure 2c2cd0237c10c3b277351a85e30fb8c0, server=jenkins-hbase4.apache.org,42217,1689447992037 in 170 msec 2023-07-15 19:07:13,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=222, resume processing ppid=221 2023-07-15 19:07:13,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=222, ppid=221, state=SUCCESS; TransitRegionStateProcedure table=testMergeRegions, region=2c2cd0237c10c3b277351a85e30fb8c0, UNASSIGN in 176 msec 2023-07-15 19:07:13,620 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMergeRegions","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448033620"}]},"ts":"1689448033620"} 2023-07-15 19:07:13,621 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMergeRegions, state=DISABLED in hbase:meta 2023-07-15 19:07:13,623 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testMergeRegions to state=DISABLED 2023-07-15 19:07:13,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=221, state=SUCCESS; DisableTableProcedure table=testMergeRegions in 191 msec 2023-07-15 19:07:13,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=221 2023-07-15 19:07:13,691 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testMergeRegions, procId: 221 completed 2023-07-15 19:07:13,692 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testMergeRegions 2023-07-15 19:07:13,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=224, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testMergeRegions 2023-07-15 19:07:13,695 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=224, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testMergeRegions 2023-07-15 19:07:13,696 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=224, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testMergeRegions 2023-07-15 19:07:13,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=224 2023-07-15 19:07:13,700 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,700 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:13,700 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:13,703 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0/d, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0/recovered.edits] 2023-07-15 19:07:13,705 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894/d, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894/recovered.edits] 2023-07-15 19:07:13,705 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56/d, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56/recovered.edits] 2023-07-15 19:07:13,711 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0/recovered.edits/10.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0/recovered.edits/10.seqid 2023-07-15 19:07:13,712 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56/recovered.edits/7.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56/recovered.edits/7.seqid 2023-07-15 19:07:13,713 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/2c2cd0237c10c3b277351a85e30fb8c0 2023-07-15 19:07:13,713 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894/recovered.edits/4.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894/recovered.edits/4.seqid 2023-07-15 19:07:13,713 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/0328fb0cfe10f794dbb42eaecad28c56 2023-07-15 19:07:13,713 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testMergeRegions/a7f601eff0d1b72e7d1bc32d59255894 2023-07-15 19:07:13,713 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMergeRegions regions 2023-07-15 19:07:13,717 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=224, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testMergeRegions 2023-07-15 19:07:13,720 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testMergeRegions from hbase:meta 2023-07-15 19:07:13,722 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testMergeRegions' descriptor. 2023-07-15 19:07:13,724 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=224, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testMergeRegions 2023-07-15 19:07:13,724 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testMergeRegions' from region states. 2023-07-15 19:07:13,724 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448033724"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:13,725 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 19:07:13,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2c2cd0237c10c3b277351a85e30fb8c0, NAME => 'testMergeRegions,,1689448030897.2c2cd0237c10c3b277351a85e30fb8c0.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 19:07:13,725 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testMergeRegions' as deleted. 2023-07-15 19:07:13,726 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMergeRegions","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448033725"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:13,727 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testMergeRegions state from META 2023-07-15 19:07:13,729 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=224, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testMergeRegions 2023-07-15 19:07:13,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=224, state=SUCCESS; DeleteTableProcedure table=testMergeRegions in 37 msec 2023-07-15 19:07:13,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=224 2023-07-15 19:07:13,948 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testMergeRegions, procId: 224 completed 2023-07-15 19:07:13,970 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testMergeRegions Thread=619 (was 611) - Thread LEAK? -, OpenFileDescriptor=746 (was 729) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 173), ProcessCount=169 (was 169), AvailableMemoryMB=5211 (was 5253) 2023-07-15 19:07:13,970 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=619 is superior to 500 2023-07-15 19:07:13,991 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testColumnValidName Thread=619, OpenFileDescriptor=746, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=169, AvailableMemoryMB=5210 2023-07-15 19:07:13,991 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=619 is superior to 500 2023-07-15 19:07:14,014 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testColumnValidName Thread=619 (was 619), OpenFileDescriptor=746 (was 746), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 173), ProcessCount=169 (was 169), AvailableMemoryMB=5209 (was 5210) 2023-07-15 19:07:14,014 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=619 is superior to 500 2023-07-15 19:07:14,036 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testHFileReplication Thread=619, OpenFileDescriptor=746, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=169, AvailableMemoryMB=5209 2023-07-15 19:07:14,036 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=619 is superior to 500 2023-07-15 19:07:14,038 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testHFileReplication', {NAME => 'defaultRep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'rep1', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', METADATA => {'DFS_REPLICATION' => '1'}} 2023-07-15 19:07:14,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=225, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testHFileReplication 2023-07-15 19:07:14,042 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=225, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testHFileReplication execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:07:14,042 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testHFileReplication" procId is: 225 2023-07-15 19:07:14,043 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=225, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testHFileReplication execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:07:14,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=225 2023-07-15 19:07:14,045 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,045 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f empty. 2023-07-15 19:07:14,046 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,046 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testHFileReplication regions 2023-07-15 19:07:14,062 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/.tabledesc/.tableinfo.0000000001 2023-07-15 19:07:14,064 INFO [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4ab9462679859166d8e54828c488590f, NAME => 'testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testHFileReplication', {NAME => 'defaultRep', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'rep1', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', METADATA => {'DFS_REPLICATION' => '1'}}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:07:14,104 DEBUG [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(866): Instantiated testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:14,105 DEBUG [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(1604): Closing 4ab9462679859166d8e54828c488590f, disabling compactions & flushes 2023-07-15 19:07:14,105 INFO [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(1626): Closing region testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,105 DEBUG [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,105 DEBUG [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(1714): Acquired close lock on testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. after waiting 0 ms 2023-07-15 19:07:14,105 DEBUG [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(1724): Updates disabled for region testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,105 INFO [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(1838): Closed testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,105 DEBUG [RegionOpenAndInit-testHFileReplication-pool-0] regionserver.HRegion(1558): Region close journal for 4ab9462679859166d8e54828c488590f: 2023-07-15 19:07:14,108 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=225, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testHFileReplication execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:07:14,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1689448034109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448034109"}]},"ts":"1689448034109"} 2023-07-15 19:07:14,110 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:07:14,111 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=225, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testHFileReplication execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:07:14,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testHFileReplication","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448034111"}]},"ts":"1689448034111"} 2023-07-15 19:07:14,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testHFileReplication, state=ENABLING in hbase:meta 2023-07-15 19:07:14,122 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:07:14,123 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:07:14,123 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:07:14,123 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:07:14,123 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:07:14,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=226, ppid=225, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testHFileReplication, region=4ab9462679859166d8e54828c488590f, ASSIGN}] 2023-07-15 19:07:14,125 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=226, ppid=225, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testHFileReplication, region=4ab9462679859166d8e54828c488590f, ASSIGN 2023-07-15 19:07:14,125 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=226, ppid=225, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testHFileReplication, region=4ab9462679859166d8e54828c488590f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42361,1689447991925; forceNewPlan=false, retain=false 2023-07-15 19:07:14,275 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:07:14,276 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=226 updating hbase:meta row=4ab9462679859166d8e54828c488590f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,276 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1689448034276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448034276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448034276"}]},"ts":"1689448034276"} 2023-07-15 19:07:14,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=227, ppid=226, state=RUNNABLE; OpenRegionProcedure 4ab9462679859166d8e54828c488590f, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:07:14,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=225 2023-07-15 19:07:14,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ab9462679859166d8e54828c488590f, NAME => 'testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:07:14,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testHFileReplication 4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:14,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,463 INFO [StoreOpener-4ab9462679859166d8e54828c488590f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family defaultRep of region 4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,466 DEBUG [StoreOpener-4ab9462679859166d8e54828c488590f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/defaultRep 2023-07-15 19:07:14,466 DEBUG [StoreOpener-4ab9462679859166d8e54828c488590f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/defaultRep 2023-07-15 19:07:14,467 INFO [StoreOpener-4ab9462679859166d8e54828c488590f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ab9462679859166d8e54828c488590f columnFamilyName defaultRep 2023-07-15 19:07:14,468 INFO [StoreOpener-4ab9462679859166d8e54828c488590f-1] regionserver.HStore(310): Store=4ab9462679859166d8e54828c488590f/defaultRep, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:14,468 INFO [StoreOpener-4ab9462679859166d8e54828c488590f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep1 of region 4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,469 DEBUG [StoreOpener-4ab9462679859166d8e54828c488590f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/rep1 2023-07-15 19:07:14,470 DEBUG [StoreOpener-4ab9462679859166d8e54828c488590f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/rep1 2023-07-15 19:07:14,470 INFO [StoreOpener-4ab9462679859166d8e54828c488590f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ab9462679859166d8e54828c488590f columnFamilyName rep1 2023-07-15 19:07:14,470 INFO [StoreOpener-4ab9462679859166d8e54828c488590f-1] regionserver.HStore(310): Store=4ab9462679859166d8e54828c488590f/rep1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:14,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testHFileReplication descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 19:07:14,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4ab9462679859166d8e54828c488590f 2023-07-15 19:07:14,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:07:14,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4ab9462679859166d8e54828c488590f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73555842, jitterRate=0.09606745839118958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 19:07:14,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4ab9462679859166d8e54828c488590f: 2023-07-15 19:07:14,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f., pid=227, masterSystemTime=1689448034435 2023-07-15 19:07:14,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,485 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=226 updating hbase:meta row=4ab9462679859166d8e54828c488590f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,485 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1689448034484"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448034484"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448034484"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448034484"}]},"ts":"1689448034484"} 2023-07-15 19:07:14,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=227, resume processing ppid=226 2023-07-15 19:07:14,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=227, ppid=226, state=SUCCESS; OpenRegionProcedure 4ab9462679859166d8e54828c488590f, server=jenkins-hbase4.apache.org,42361,1689447991925 in 208 msec 2023-07-15 19:07:14,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=226, resume processing ppid=225 2023-07-15 19:07:14,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=226, ppid=225, state=SUCCESS; TransitRegionStateProcedure table=testHFileReplication, region=4ab9462679859166d8e54828c488590f, ASSIGN in 365 msec 2023-07-15 19:07:14,491 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=225, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testHFileReplication execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:07:14,492 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testHFileReplication","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448034492"}]},"ts":"1689448034492"} 2023-07-15 19:07:14,493 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testHFileReplication, state=ENABLED in hbase:meta 2023-07-15 19:07:14,496 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=225, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testHFileReplication execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:07:14,498 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=225, state=SUCCESS; CreateTableProcedure table=testHFileReplication in 458 msec 2023-07-15 19:07:14,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=225 2023-07-15 19:07:14,801 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testHFileReplication, procId: 225 completed 2023-07-15 19:07:14,801 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testHFileReplication get assigned. Timeout = 60000ms 2023-07-15 19:07:14,801 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:07:14,804 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=14,queue=2,port=42361] regionserver.StoreScanner(1093): Switch to stream read (scanned=32862 bytes) of info 2023-07-15 19:07:14,807 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testHFileReplication assigned to meta. Checking AM states. 2023-07-15 19:07:14,807 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:07:14,807 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testHFileReplication assigned. 2023-07-15 19:07:14,807 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:07:14,818 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 19:07:14,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure.ProcedureCoordinator(165): Submitting procedure testHFileReplication 2023-07-15 19:07:14,820 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testHFileReplication' 2023-07-15 19:07:14,820 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:07:14,821 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testHFileReplication' starting 'acquire' 2023-07-15 19:07:14,821 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testHFileReplication', kicking off acquire phase on members. 2023-07-15 19:07:14,822 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,822 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,823 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:07:14,823 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:07:14,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:07:14,823 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:07:14,823 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:07:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:07:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:07:14,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:07:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:07:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,824 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,824 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 19:07:14,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testHFileReplication 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testHFileReplication 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testHFileReplication 2023-07-15 19:07:14,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testHFileReplication 2023-07-15 19:07:14,827 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testHFileReplication' with timeout 60000ms 2023-07-15 19:07:14,827 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:07:14,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testHFileReplication 2023-07-15 19:07:14,829 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testHFileReplication 2023-07-15 19:07:14,829 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testHFileReplication' with timeout 60000ms 2023-07-15 19:07:14,829 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testHFileReplication' with timeout 60000ms 2023-07-15 19:07:14,829 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testHFileReplication' starting 'acquire' stage 2023-07-15 19:07:14,829 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:07:14,829 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 19:07:14,829 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testHFileReplication' locally acquired 2023-07-15 19:07:14,830 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testHFileReplication' starting 'acquire' stage 2023-07-15 19:07:14,830 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testHFileReplication' starting 'acquire' stage 2023-07-15 19:07:14,830 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testHFileReplication' locally acquired 2023-07-15 19:07:14,830 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42217,1689447992037' joining acquired barrier for procedure (testHFileReplication) in zk 2023-07-15 19:07:14,830 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36223,1689447992001' joining acquired barrier for procedure (testHFileReplication) in zk 2023-07-15 19:07:14,830 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 19:07:14,831 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 19:07:14,831 DEBUG [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,831 DEBUG [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. started... 2023-07-15 19:07:14,831 INFO [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4ab9462679859166d8e54828c488590f 2/2 column families, dataSize=82 B heapSize=744 B 2023-07-15 19:07:14,833 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,834 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,834 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testHFileReplication' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:07:14,834 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,836 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,836 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testHFileReplication' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:07:14,875 INFO [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=47 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/.tmp/defaultRep/17f0d44fd37848c8830fd655bf7720d5 2023-07-15 19:07:14,902 INFO [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=35 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/.tmp/rep1/ccdefe6212af468e92730d6942b17923 2023-07-15 19:07:14,912 DEBUG [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/.tmp/defaultRep/17f0d44fd37848c8830fd655bf7720d5 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/defaultRep/17f0d44fd37848c8830fd655bf7720d5 2023-07-15 19:07:14,928 INFO [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/defaultRep/17f0d44fd37848c8830fd655bf7720d5, entries=1, sequenceid=5, filesize=4.8 K 2023-07-15 19:07:14,930 DEBUG [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/.tmp/rep1/ccdefe6212af468e92730d6942b17923 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/rep1/ccdefe6212af468e92730d6942b17923 2023-07-15 19:07:14,942 INFO [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/rep1/ccdefe6212af468e92730d6942b17923, entries=1, sequenceid=5, filesize=4.8 K 2023-07-15 19:07:14,943 INFO [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~82 B/82, heapSize ~712 B/712, currentSize=0 B/0 for 4ab9462679859166d8e54828c488590f in 112ms, sequenceid=5, compaction requested=false 2023-07-15 19:07:14,943 DEBUG [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testHFileReplication' 2023-07-15 19:07:14,944 DEBUG [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4ab9462679859166d8e54828c488590f: 2023-07-15 19:07:14,944 DEBUG [rs(jenkins-hbase4.apache.org,42361,1689447991925)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:14,944 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 19:07:14,944 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 19:07:14,944 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,945 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testHFileReplication' locally acquired 2023-07-15 19:07:14,945 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42361,1689447991925' joining acquired barrier for procedure (testHFileReplication) in zk 2023-07-15 19:07:14,947 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,947 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:07:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:07:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:07:14,948 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,948 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testHFileReplication' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 19:07:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:07:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testHFileReplication 2023-07-15 19:07:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:07:14,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42361,1689447991925' joining acquired barrier for procedure 'testHFileReplication' on coordinator 2023-07-15 19:07:14,951 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testHFileReplication' starting 'in-barrier' execution. 2023-07-15 19:07:14,951 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41a83654[Count = 0] remaining members to acquire global barrier 2023-07-15 19:07:14,953 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testHFileReplication' received 'reached' from coordinator. 2023-07-15 19:07:14,953 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testHFileReplication' locally completed 2023-07-15 19:07:14,953 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testHFileReplication' completed for member 'jenkins-hbase4.apache.org,36223,1689447992001' in zk 2023-07-15 19:07:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,953 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testHFileReplication' received 'reached' from coordinator. 2023-07-15 19:07:14,953 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testHFileReplication' locally completed 2023-07-15 19:07:14,954 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testHFileReplication' completed for member 'jenkins-hbase4.apache.org,42361,1689447991925' in zk 2023-07-15 19:07:14,953 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testHFileReplication' received 'reached' from coordinator. 2023-07-15 19:07:14,954 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testHFileReplication' locally completed 2023-07-15 19:07:14,954 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,954 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 19:07:14,954 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testHFileReplication' completed for member 'jenkins-hbase4.apache.org,42217,1689447992037' in zk 2023-07-15 19:07:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testHFileReplication' has notified controller of completion 2023-07-15 19:07:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testHFileReplication' has notified controller of completion 2023-07-15 19:07:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:07:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:07:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,42361,1689447991925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testHFileReplication' completed. 2023-07-15 19:07:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,42217,1689447992037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testHFileReplication' completed. 2023-07-15 19:07:14,959 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,959 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testHFileReplication' has notified controller of completion 2023-07-15 19:07:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:07:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:07:14,959 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:07:14,959 DEBUG [member: 'jenkins-hbase4.apache.org,36223,1689447992001' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testHFileReplication' completed. 2023-07-15 19:07:14,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:07:14,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:07:14,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testHFileReplication 2023-07-15 19:07:14,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:07:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testHFileReplication 2023-07-15 19:07:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testHFileReplication' member 'jenkins-hbase4.apache.org,42361,1689447991925': 2023-07-15 19:07:14,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42361,1689447991925' released barrier for procedure'testHFileReplication', counting down latch. Waiting for 0 more 2023-07-15 19:07:14,965 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testHFileReplication' execution completed 2023-07-15 19:07:14,965 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 19:07:14,965 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 19:07:14,965 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testHFileReplication 2023-07-15 19:07:14,965 INFO [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testHFileReplicationincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 19:07:14,969 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,969 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 19:07:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 19:07:14,969 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,969 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:07:14,969 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:07:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:07:14,970 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:07:14,969 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 19:07:14,970 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:07:14,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:07:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:07:14,971 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:07:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:07:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testHFileReplication 2023-07-15 19:07:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,972 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 19:07:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testHFileReplication 2023-07-15 19:07:14,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,974 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 19:07:14,974 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testHFileReplication 2023-07-15 19:07:14,975 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,979 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:07:14,979 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:07:14,979 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:07:14,980 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:07:14,980 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 19:07:14,980 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 19:07:14,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:07:14,980 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:07:14,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:07:14,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 19:07:14,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:07:14,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 19:07:14,980 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,980 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,981 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testHFileReplication/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,981 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testHFileReplication 2023-07-15 19:07:14,981 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:14,981 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,981 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:14,981 DEBUG [(jenkins-hbase4.apache.org,46803,1689447990709)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 19:07:14,981 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:14,981 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testHFileReplication' 2023-07-15 19:07:14,982 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 19:07:14,982 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testHFileReplication 2023-07-15 19:07:14,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:07:14,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:07:14,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:07:14,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 19:07:14,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:07:14,982 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testHFileReplication 2023-07-15 19:07:14,983 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testHFileReplication'' to complete. (max 50000 ms per retry) 2023-07-15 19:07:14,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 19:07:14,983 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 19:07:15,233 DEBUG [Listener at localhost/45529] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 19:07:15,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-15 19:07:15,235 INFO [Listener at localhost/45529] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 19:07:15,242 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testHFileReplication 2023-07-15 19:07:15,242 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testHFileReplication 2023-07-15 19:07:15,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=228, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testHFileReplication 2023-07-15 19:07:15,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=228 2023-07-15 19:07:15,248 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testHFileReplication","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448035248"}]},"ts":"1689448035248"} 2023-07-15 19:07:15,249 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testHFileReplication, state=DISABLING in hbase:meta 2023-07-15 19:07:15,252 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testHFileReplication to state=DISABLING 2023-07-15 19:07:15,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=229, ppid=228, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testHFileReplication, region=4ab9462679859166d8e54828c488590f, UNASSIGN}] 2023-07-15 19:07:15,253 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=229, ppid=228, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testHFileReplication, region=4ab9462679859166d8e54828c488590f, UNASSIGN 2023-07-15 19:07:15,254 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=229 updating hbase:meta row=4ab9462679859166d8e54828c488590f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:15,254 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1689448035254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448035254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448035254"}]},"ts":"1689448035254"} 2023-07-15 19:07:15,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=230, ppid=229, state=RUNNABLE; CloseRegionProcedure 4ab9462679859166d8e54828c488590f, server=jenkins-hbase4.apache.org,42361,1689447991925}] 2023-07-15 19:07:15,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4ab9462679859166d8e54828c488590f 2023-07-15 19:07:15,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4ab9462679859166d8e54828c488590f, disabling compactions & flushes 2023-07-15 19:07:15,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:15,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:15,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. after waiting 0 ms 2023-07-15 19:07:15,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:15,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 19:07:15,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f. 2023-07-15 19:07:15,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4ab9462679859166d8e54828c488590f: 2023-07-15 19:07:15,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4ab9462679859166d8e54828c488590f 2023-07-15 19:07:15,434 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=229 updating hbase:meta row=4ab9462679859166d8e54828c488590f, regionState=CLOSED 2023-07-15 19:07:15,434 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1689448035434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448035434"}]},"ts":"1689448035434"} 2023-07-15 19:07:15,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=230, resume processing ppid=229 2023-07-15 19:07:15,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=230, ppid=229, state=SUCCESS; CloseRegionProcedure 4ab9462679859166d8e54828c488590f, server=jenkins-hbase4.apache.org,42361,1689447991925 in 168 msec 2023-07-15 19:07:15,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=229, resume processing ppid=228 2023-07-15 19:07:15,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=229, ppid=228, state=SUCCESS; TransitRegionStateProcedure table=testHFileReplication, region=4ab9462679859166d8e54828c488590f, UNASSIGN in 185 msec 2023-07-15 19:07:15,441 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testHFileReplication","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448035441"}]},"ts":"1689448035441"} 2023-07-15 19:07:15,443 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testHFileReplication, state=DISABLED in hbase:meta 2023-07-15 19:07:15,444 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testHFileReplication to state=DISABLED 2023-07-15 19:07:15,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=228, state=SUCCESS; DisableTableProcedure table=testHFileReplication in 205 msec 2023-07-15 19:07:15,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=228 2023-07-15 19:07:15,499 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testHFileReplication, procId: 228 completed 2023-07-15 19:07:15,501 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testHFileReplication 2023-07-15 19:07:15,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=231, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testHFileReplication 2023-07-15 19:07:15,504 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=231, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testHFileReplication 2023-07-15 19:07:15,505 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=231, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testHFileReplication 2023-07-15 19:07:15,509 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f 2023-07-15 19:07:15,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=231 2023-07-15 19:07:15,513 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/defaultRep, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/recovered.edits, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/rep1] 2023-07-15 19:07:15,519 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/defaultRep/17f0d44fd37848c8830fd655bf7720d5 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/defaultRep/17f0d44fd37848c8830fd655bf7720d5 2023-07-15 19:07:15,524 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/recovered.edits/8.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/recovered.edits/8.seqid 2023-07-15 19:07:15,528 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/rep1/ccdefe6212af468e92730d6942b17923 to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f/rep1/ccdefe6212af468e92730d6942b17923 2023-07-15 19:07:15,529 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testHFileReplication/4ab9462679859166d8e54828c488590f 2023-07-15 19:07:15,529 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testHFileReplication regions 2023-07-15 19:07:15,532 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=231, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testHFileReplication 2023-07-15 19:07:15,533 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testHFileReplication from hbase:meta 2023-07-15 19:07:15,535 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testHFileReplication' descriptor. 2023-07-15 19:07:15,536 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=231, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testHFileReplication 2023-07-15 19:07:15,536 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testHFileReplication' from region states. 2023-07-15 19:07:15,536 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448035536"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:15,543 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 19:07:15,543 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4ab9462679859166d8e54828c488590f, NAME => 'testHFileReplication,,1689448034038.4ab9462679859166d8e54828c488590f.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 19:07:15,543 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testHFileReplication' as deleted. 2023-07-15 19:07:15,543 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testHFileReplication","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448035543"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:15,546 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testHFileReplication state from META 2023-07-15 19:07:15,549 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=231, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testHFileReplication 2023-07-15 19:07:15,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=231, state=SUCCESS; DeleteTableProcedure table=testHFileReplication in 48 msec 2023-07-15 19:07:15,561 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 19:07:15,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=231 2023-07-15 19:07:15,763 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testHFileReplication, procId: 231 completed 2023-07-15 19:07:15,798 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testHFileReplication Thread=617 (was 619), OpenFileDescriptor=742 (was 746), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 173) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=5190 (was 5209) 2023-07-15 19:07:15,798 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=617 is superior to 500 2023-07-15 19:07:15,823 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testCompactRegionWithTableName Thread=617, OpenFileDescriptor=742, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=169, AvailableMemoryMB=5189 2023-07-15 19:07:15,823 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=617 is superior to 500 2023-07-15 19:07:15,825 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactRegionWithTableName', {NAME => 'fam1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 19:07:15,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=232, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactRegionWithTableName 2023-07-15 19:07:15,829 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=232, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactRegionWithTableName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:07:15,829 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactRegionWithTableName" procId is: 232 2023-07-15 19:07:15,869 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=232, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactRegionWithTableName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:07:15,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=232 2023-07-15 19:07:15,872 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:15,873 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030 empty. 2023-07-15 19:07:15,873 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:15,873 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactRegionWithTableName regions 2023-07-15 19:07:15,902 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/.tabledesc/.tableinfo.0000000001 2023-07-15 19:07:15,905 INFO [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b54384a28b554ba2c3d6944690d82030, NAME => 'testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testCompactRegionWithTableName', {NAME => 'fam1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:07:15,915 DEBUG [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(866): Instantiated testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:15,915 DEBUG [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(1604): Closing b54384a28b554ba2c3d6944690d82030, disabling compactions & flushes 2023-07-15 19:07:15,915 INFO [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(1626): Closing region testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:15,915 DEBUG [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:15,915 DEBUG [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. after waiting 0 ms 2023-07-15 19:07:15,915 DEBUG [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:15,915 INFO [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(1838): Closed testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:15,915 DEBUG [RegionOpenAndInit-testCompactRegionWithTableName-pool-0] regionserver.HRegion(1558): Region close journal for b54384a28b554ba2c3d6944690d82030: 2023-07-15 19:07:15,918 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=232, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactRegionWithTableName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:07:15,920 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689448035920"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448035920"}]},"ts":"1689448035920"} 2023-07-15 19:07:15,921 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:07:15,922 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=232, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactRegionWithTableName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:07:15,922 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactRegionWithTableName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448035922"}]},"ts":"1689448035922"} 2023-07-15 19:07:15,923 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactRegionWithTableName, state=ENABLING in hbase:meta 2023-07-15 19:07:15,927 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:07:15,927 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:07:15,928 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:07:15,928 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:07:15,928 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:07:15,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=233, ppid=232, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactRegionWithTableName, region=b54384a28b554ba2c3d6944690d82030, ASSIGN}] 2023-07-15 19:07:15,929 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=233, ppid=232, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactRegionWithTableName, region=b54384a28b554ba2c3d6944690d82030, ASSIGN 2023-07-15 19:07:15,929 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=233, ppid=232, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactRegionWithTableName, region=b54384a28b554ba2c3d6944690d82030, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36223,1689447992001; forceNewPlan=false, retain=false 2023-07-15 19:07:16,079 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:07:16,080 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=233 updating hbase:meta row=b54384a28b554ba2c3d6944690d82030, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:16,080 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689448036080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448036080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448036080"}]},"ts":"1689448036080"} 2023-07-15 19:07:16,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=234, ppid=233, state=RUNNABLE; OpenRegionProcedure b54384a28b554ba2c3d6944690d82030, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:07:16,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=232 2023-07-15 19:07:16,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b54384a28b554ba2c3d6944690d82030, NAME => 'testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:07:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactRegionWithTableName b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,238 INFO [StoreOpener-b54384a28b554ba2c3d6944690d82030-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family fam1 of region b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,240 DEBUG [StoreOpener-b54384a28b554ba2c3d6944690d82030-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030/fam1 2023-07-15 19:07:16,240 DEBUG [StoreOpener-b54384a28b554ba2c3d6944690d82030-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030/fam1 2023-07-15 19:07:16,240 INFO [StoreOpener-b54384a28b554ba2c3d6944690d82030-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b54384a28b554ba2c3d6944690d82030 columnFamilyName fam1 2023-07-15 19:07:16,240 INFO [StoreOpener-b54384a28b554ba2c3d6944690d82030-1] regionserver.HStore(310): Store=b54384a28b554ba2c3d6944690d82030/fam1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:16,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:07:16,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b54384a28b554ba2c3d6944690d82030; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62077248, jitterRate=-0.07497692108154297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:07:16,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b54384a28b554ba2c3d6944690d82030: 2023-07-15 19:07:16,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030., pid=234, masterSystemTime=1689448036233 2023-07-15 19:07:16,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:16,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:16,252 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=233 updating hbase:meta row=b54384a28b554ba2c3d6944690d82030, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:16,252 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689448036252"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448036252"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448036252"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448036252"}]},"ts":"1689448036252"} 2023-07-15 19:07:16,254 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=234, resume processing ppid=233 2023-07-15 19:07:16,254 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=234, ppid=233, state=SUCCESS; OpenRegionProcedure b54384a28b554ba2c3d6944690d82030, server=jenkins-hbase4.apache.org,36223,1689447992001 in 172 msec 2023-07-15 19:07:16,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=233, resume processing ppid=232 2023-07-15 19:07:16,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=233, ppid=232, state=SUCCESS; TransitRegionStateProcedure table=testCompactRegionWithTableName, region=b54384a28b554ba2c3d6944690d82030, ASSIGN in 326 msec 2023-07-15 19:07:16,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=232, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactRegionWithTableName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:07:16,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactRegionWithTableName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448036256"}]},"ts":"1689448036256"} 2023-07-15 19:07:16,257 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactRegionWithTableName, state=ENABLED in hbase:meta 2023-07-15 19:07:16,260 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=232, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactRegionWithTableName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:07:16,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=232, state=SUCCESS; CreateTableProcedure table=testCompactRegionWithTableName in 435 msec 2023-07-15 19:07:16,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=232 2023-07-15 19:07:16,622 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactRegionWithTableName, procId: 232 completed 2023-07-15 19:07:16,624 INFO [Listener at localhost/45529] client.TestAdmin1(96): This is expected 2023-07-15 19:07:16,624 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testCompactRegionWithTableName 2023-07-15 19:07:16,625 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactRegionWithTableName 2023-07-15 19:07:16,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=235, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactRegionWithTableName 2023-07-15 19:07:16,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=235 2023-07-15 19:07:16,628 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactRegionWithTableName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448036627"}]},"ts":"1689448036627"} 2023-07-15 19:07:16,628 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactRegionWithTableName, state=DISABLING in hbase:meta 2023-07-15 19:07:16,630 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactRegionWithTableName to state=DISABLING 2023-07-15 19:07:16,630 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=236, ppid=235, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactRegionWithTableName, region=b54384a28b554ba2c3d6944690d82030, UNASSIGN}] 2023-07-15 19:07:16,631 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=236, ppid=235, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactRegionWithTableName, region=b54384a28b554ba2c3d6944690d82030, UNASSIGN 2023-07-15 19:07:16,631 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=236 updating hbase:meta row=b54384a28b554ba2c3d6944690d82030, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:16,631 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689448036631"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448036631"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448036631"}]},"ts":"1689448036631"} 2023-07-15 19:07:16,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=237, ppid=236, state=RUNNABLE; CloseRegionProcedure b54384a28b554ba2c3d6944690d82030, server=jenkins-hbase4.apache.org,36223,1689447992001}] 2023-07-15 19:07:16,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b54384a28b554ba2c3d6944690d82030, disabling compactions & flushes 2023-07-15 19:07:16,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:16,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:16,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. after waiting 0 ms 2023-07-15 19:07:16,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:16,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-15 19:07:16,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030. 2023-07-15 19:07:16,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b54384a28b554ba2c3d6944690d82030: 2023-07-15 19:07:16,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,789 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=236 updating hbase:meta row=b54384a28b554ba2c3d6944690d82030, regionState=CLOSED 2023-07-15 19:07:16,789 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689448036789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448036789"}]},"ts":"1689448036789"} 2023-07-15 19:07:16,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=237, resume processing ppid=236 2023-07-15 19:07:16,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=237, ppid=236, state=SUCCESS; CloseRegionProcedure b54384a28b554ba2c3d6944690d82030, server=jenkins-hbase4.apache.org,36223,1689447992001 in 158 msec 2023-07-15 19:07:16,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=236, resume processing ppid=235 2023-07-15 19:07:16,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=236, ppid=235, state=SUCCESS; TransitRegionStateProcedure table=testCompactRegionWithTableName, region=b54384a28b554ba2c3d6944690d82030, UNASSIGN in 161 msec 2023-07-15 19:07:16,793 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactRegionWithTableName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448036793"}]},"ts":"1689448036793"} 2023-07-15 19:07:16,794 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactRegionWithTableName, state=DISABLED in hbase:meta 2023-07-15 19:07:16,797 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactRegionWithTableName to state=DISABLED 2023-07-15 19:07:16,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=235, state=SUCCESS; DisableTableProcedure table=testCompactRegionWithTableName in 172 msec 2023-07-15 19:07:16,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=235 2023-07-15 19:07:16,879 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactRegionWithTableName, procId: 235 completed 2023-07-15 19:07:16,880 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testCompactRegionWithTableName 2023-07-15 19:07:16,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=238, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testCompactRegionWithTableName 2023-07-15 19:07:16,882 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=238, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testCompactRegionWithTableName 2023-07-15 19:07:16,883 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=238, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testCompactRegionWithTableName 2023-07-15 19:07:16,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=238 2023-07-15 19:07:16,885 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,887 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030/fam1, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030/recovered.edits] 2023-07-15 19:07:16,891 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030/recovered.edits/4.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030/recovered.edits/4.seqid 2023-07-15 19:07:16,891 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testCompactRegionWithTableName/b54384a28b554ba2c3d6944690d82030 2023-07-15 19:07:16,891 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactRegionWithTableName regions 2023-07-15 19:07:16,893 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=238, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testCompactRegionWithTableName 2023-07-15 19:07:16,894 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testCompactRegionWithTableName from hbase:meta 2023-07-15 19:07:16,896 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testCompactRegionWithTableName' descriptor. 2023-07-15 19:07:16,896 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=238, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testCompactRegionWithTableName 2023-07-15 19:07:16,896 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testCompactRegionWithTableName' from region states. 2023-07-15 19:07:16,897 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448036896"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:16,898 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 19:07:16,898 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b54384a28b554ba2c3d6944690d82030, NAME => 'testCompactRegionWithTableName,,1689448035825.b54384a28b554ba2c3d6944690d82030.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 19:07:16,898 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testCompactRegionWithTableName' as deleted. 2023-07-15 19:07:16,898 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactRegionWithTableName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448036898"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:16,899 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testCompactRegionWithTableName state from META 2023-07-15 19:07:16,900 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=238, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testCompactRegionWithTableName 2023-07-15 19:07:16,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=238, state=SUCCESS; DeleteTableProcedure table=testCompactRegionWithTableName in 21 msec 2023-07-15 19:07:17,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=238 2023-07-15 19:07:17,134 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testCompactRegionWithTableName, procId: 238 completed 2023-07-15 19:07:17,159 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testCompactRegionWithTableName Thread=617 (was 617), OpenFileDescriptor=742 (was 742), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 216), ProcessCount=169 (was 169), AvailableMemoryMB=5167 (was 5189) 2023-07-15 19:07:17,159 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=617 is superior to 500 2023-07-15 19:07:17,199 INFO [Listener at localhost/45529] hbase.ResourceChecker(147): before: client.TestAdmin1#testTableExist Thread=617, OpenFileDescriptor=742, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=169, AvailableMemoryMB=5167 2023-07-15 19:07:17,199 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=617 is superior to 500 2023-07-15 19:07:17,202 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testTableExist', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 19:07:17,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=239, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testTableExist 2023-07-15 19:07:17,205 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=239, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testTableExist execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 19:07:17,205 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testTableExist" procId is: 239 2023-07-15 19:07:17,205 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=239, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testTableExist execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 19:07:17,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=239 2023-07-15 19:07:17,207 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,208 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05 empty. 2023-07-15 19:07:17,208 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,208 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testTableExist regions 2023-07-15 19:07:17,222 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/.tabledesc/.tableinfo.0000000001 2023-07-15 19:07:17,224 INFO [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(7675): creating {ENCODED => a2d7ef3f7a89679e4f00d35a227fbf05, NAME => 'testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testTableExist', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp 2023-07-15 19:07:17,232 DEBUG [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(866): Instantiated testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:17,233 DEBUG [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(1604): Closing a2d7ef3f7a89679e4f00d35a227fbf05, disabling compactions & flushes 2023-07-15 19:07:17,233 INFO [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(1626): Closing region testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:17,233 DEBUG [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:17,233 DEBUG [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(1714): Acquired close lock on testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. after waiting 0 ms 2023-07-15 19:07:17,233 DEBUG [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(1724): Updates disabled for region testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:17,233 INFO [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(1838): Closed testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:17,233 DEBUG [RegionOpenAndInit-testTableExist-pool-0] regionserver.HRegion(1558): Region close journal for a2d7ef3f7a89679e4f00d35a227fbf05: 2023-07-15 19:07:17,235 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=239, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testTableExist execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 19:07:17,236 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448037236"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448037236"}]},"ts":"1689448037236"} 2023-07-15 19:07:17,237 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 19:07:17,238 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=239, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testTableExist execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 19:07:17,238 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testTableExist","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448037238"}]},"ts":"1689448037238"} 2023-07-15 19:07:17,239 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testTableExist, state=ENABLING in hbase:meta 2023-07-15 19:07:17,248 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 19:07:17,248 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 19:07:17,248 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 19:07:17,248 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 19:07:17,248 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 19:07:17,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=240, ppid=239, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testTableExist, region=a2d7ef3f7a89679e4f00d35a227fbf05, ASSIGN}] 2023-07-15 19:07:17,250 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=240, ppid=239, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testTableExist, region=a2d7ef3f7a89679e4f00d35a227fbf05, ASSIGN 2023-07-15 19:07:17,250 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=240, ppid=239, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testTableExist, region=a2d7ef3f7a89679e4f00d35a227fbf05, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42217,1689447992037; forceNewPlan=false, retain=false 2023-07-15 19:07:17,401 INFO [jenkins-hbase4:46803] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 19:07:17,401 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=240 updating hbase:meta row=a2d7ef3f7a89679e4f00d35a227fbf05, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:17,401 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448037401"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448037401"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448037401"}]},"ts":"1689448037401"} 2023-07-15 19:07:17,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=241, ppid=240, state=RUNNABLE; OpenRegionProcedure a2d7ef3f7a89679e4f00d35a227fbf05, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:17,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=239 2023-07-15 19:07:17,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:17,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2d7ef3f7a89679e4f00d35a227fbf05, NAME => 'testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.', STARTKEY => '', ENDKEY => ''} 2023-07-15 19:07:17,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testTableExist a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 19:07:17,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,560 INFO [StoreOpener-a2d7ef3f7a89679e4f00d35a227fbf05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,561 DEBUG [StoreOpener-a2d7ef3f7a89679e4f00d35a227fbf05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05/info 2023-07-15 19:07:17,561 DEBUG [StoreOpener-a2d7ef3f7a89679e4f00d35a227fbf05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05/info 2023-07-15 19:07:17,562 INFO [StoreOpener-a2d7ef3f7a89679e4f00d35a227fbf05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2d7ef3f7a89679e4f00d35a227fbf05 columnFamilyName info 2023-07-15 19:07:17,562 INFO [StoreOpener-a2d7ef3f7a89679e4f00d35a227fbf05-1] regionserver.HStore(310): Store=a2d7ef3f7a89679e4f00d35a227fbf05/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 19:07:17,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:17,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 19:07:17,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a2d7ef3f7a89679e4f00d35a227fbf05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70692574, jitterRate=0.053401440382003784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 19:07:17,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a2d7ef3f7a89679e4f00d35a227fbf05: 2023-07-15 19:07:17,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05., pid=241, masterSystemTime=1689448037554 2023-07-15 19:07:17,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:17,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:17,571 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=240 updating hbase:meta row=a2d7ef3f7a89679e4f00d35a227fbf05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:17,571 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448037571"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689448037571"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689448037571"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689448037571"}]},"ts":"1689448037571"} 2023-07-15 19:07:17,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=241, resume processing ppid=240 2023-07-15 19:07:17,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=241, ppid=240, state=SUCCESS; OpenRegionProcedure a2d7ef3f7a89679e4f00d35a227fbf05, server=jenkins-hbase4.apache.org,42217,1689447992037 in 170 msec 2023-07-15 19:07:17,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=240, resume processing ppid=239 2023-07-15 19:07:17,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=240, ppid=239, state=SUCCESS; TransitRegionStateProcedure table=testTableExist, region=a2d7ef3f7a89679e4f00d35a227fbf05, ASSIGN in 325 msec 2023-07-15 19:07:17,576 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=239, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testTableExist execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 19:07:17,577 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testTableExist","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448037576"}]},"ts":"1689448037576"} 2023-07-15 19:07:17,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testTableExist, state=ENABLED in hbase:meta 2023-07-15 19:07:17,580 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=239, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testTableExist execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 19:07:17,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=239, state=SUCCESS; CreateTableProcedure table=testTableExist in 379 msec 2023-07-15 19:07:17,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=239 2023-07-15 19:07:17,958 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testTableExist, procId: 239 completed 2023-07-15 19:07:17,958 DEBUG [Listener at localhost/45529] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testTableExist get assigned. Timeout = 60000ms 2023-07-15 19:07:17,959 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:07:17,961 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=12,queue=2,port=42361] regionserver.StoreScanner(1093): Switch to stream read (scanned=32807 bytes) of info 2023-07-15 19:07:17,963 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3484): All regions for table testTableExist assigned to meta. Checking AM states. 2023-07-15 19:07:17,964 INFO [Listener at localhost/45529] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 19:07:17,964 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(3504): All regions for table testTableExist assigned. 2023-07-15 19:07:17,966 INFO [Listener at localhost/45529] client.HBaseAdmin$15(890): Started disable of testTableExist 2023-07-15 19:07:17,966 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testTableExist 2023-07-15 19:07:17,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=242, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testTableExist 2023-07-15 19:07:17,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=242 2023-07-15 19:07:17,969 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testTableExist","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448037969"}]},"ts":"1689448037969"} 2023-07-15 19:07:17,970 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testTableExist, state=DISABLING in hbase:meta 2023-07-15 19:07:17,971 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testTableExist to state=DISABLING 2023-07-15 19:07:17,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=243, ppid=242, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testTableExist, region=a2d7ef3f7a89679e4f00d35a227fbf05, UNASSIGN}] 2023-07-15 19:07:17,972 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=243, ppid=242, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testTableExist, region=a2d7ef3f7a89679e4f00d35a227fbf05, UNASSIGN 2023-07-15 19:07:17,973 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=243 updating hbase:meta row=a2d7ef3f7a89679e4f00d35a227fbf05, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:17,973 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448037973"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689448037973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689448037973"}]},"ts":"1689448037973"} 2023-07-15 19:07:17,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=244, ppid=243, state=RUNNABLE; CloseRegionProcedure a2d7ef3f7a89679e4f00d35a227fbf05, server=jenkins-hbase4.apache.org,42217,1689447992037}] 2023-07-15 19:07:18,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:18,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a2d7ef3f7a89679e4f00d35a227fbf05, disabling compactions & flushes 2023-07-15 19:07:18,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:18,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:18,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. after waiting 0 ms 2023-07-15 19:07:18,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:18,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-15 19:07:18,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05. 2023-07-15 19:07:18,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a2d7ef3f7a89679e4f00d35a227fbf05: 2023-07-15 19:07:18,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:18,131 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=243 updating hbase:meta row=a2d7ef3f7a89679e4f00d35a227fbf05, regionState=CLOSED 2023-07-15 19:07:18,132 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.","families":{"info":[{"qualifier":"regioninfo","vlen":48,"tag":[],"timestamp":"1689448038131"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689448038131"}]},"ts":"1689448038131"} 2023-07-15 19:07:18,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=244, resume processing ppid=243 2023-07-15 19:07:18,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=244, ppid=243, state=SUCCESS; CloseRegionProcedure a2d7ef3f7a89679e4f00d35a227fbf05, server=jenkins-hbase4.apache.org,42217,1689447992037 in 159 msec 2023-07-15 19:07:18,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=243, resume processing ppid=242 2023-07-15 19:07:18,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=243, ppid=242, state=SUCCESS; TransitRegionStateProcedure table=testTableExist, region=a2d7ef3f7a89679e4f00d35a227fbf05, UNASSIGN in 162 msec 2023-07-15 19:07:18,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testTableExist","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689448038135"}]},"ts":"1689448038135"} 2023-07-15 19:07:18,136 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testTableExist, state=DISABLED in hbase:meta 2023-07-15 19:07:18,138 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testTableExist to state=DISABLED 2023-07-15 19:07:18,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=242, state=SUCCESS; DisableTableProcedure table=testTableExist in 172 msec 2023-07-15 19:07:18,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=242 2023-07-15 19:07:18,220 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testTableExist, procId: 242 completed 2023-07-15 19:07:18,221 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testTableExist 2023-07-15 19:07:18,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] procedure2.ProcedureExecutor(1029): Stored pid=245, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testTableExist 2023-07-15 19:07:18,223 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=245, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testTableExist 2023-07-15 19:07:18,224 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=245, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testTableExist 2023-07-15 19:07:18,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=245 2023-07-15 19:07:18,226 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:18,228 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05/info, FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05/recovered.edits] 2023-07-15 19:07:18,231 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05/recovered.edits/4.seqid to hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/archive/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05/recovered.edits/4.seqid 2023-07-15 19:07:18,232 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/.tmp/data/default/testTableExist/a2d7ef3f7a89679e4f00d35a227fbf05 2023-07-15 19:07:18,232 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testTableExist regions 2023-07-15 19:07:18,234 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=245, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testTableExist 2023-07-15 19:07:18,235 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testTableExist from hbase:meta 2023-07-15 19:07:18,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testTableExist' descriptor. 2023-07-15 19:07:18,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=245, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testTableExist 2023-07-15 19:07:18,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testTableExist' from region states. 2023-07-15 19:07:18,238 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689448038237"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:18,239 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 19:07:18,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a2d7ef3f7a89679e4f00d35a227fbf05, NAME => 'testTableExist,,1689448037202.a2d7ef3f7a89679e4f00d35a227fbf05.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 19:07:18,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testTableExist' as deleted. 2023-07-15 19:07:18,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testTableExist","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689448038239"}]},"ts":"9223372036854775807"} 2023-07-15 19:07:18,240 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testTableExist state from META 2023-07-15 19:07:18,242 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=245, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testTableExist 2023-07-15 19:07:18,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=245, state=SUCCESS; DeleteTableProcedure table=testTableExist in 21 msec 2023-07-15 19:07:18,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=46803] master.MasterRpcServices(1230): Checking to see if procedure is done pid=245 2023-07-15 19:07:18,475 INFO [Listener at localhost/45529] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testTableExist, procId: 245 completed 2023-07-15 19:07:18,492 INFO [Listener at localhost/45529] hbase.ResourceChecker(175): after: client.TestAdmin1#testTableExist Thread=613 (was 617), OpenFileDescriptor=742 (was 742), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 216), ProcessCount=169 (was 169), AvailableMemoryMB=5165 (was 5167) 2023-07-15 19:07:18,492 WARN [Listener at localhost/45529] hbase.ResourceChecker(130): Thread=613 is superior to 500 2023-07-15 19:07:18,492 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 19:07:18,492 INFO [Listener at localhost/45529] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 19:07:18,493 DEBUG [Listener at localhost/45529] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23beefe9 to 127.0.0.1:56639 2023-07-15 19:07:18,493 DEBUG [Listener at localhost/45529] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,494 DEBUG [Listener at localhost/45529] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 19:07:18,494 DEBUG [Listener at localhost/45529] util.JVMClusterUtil(257): Found active master hash=219868326, stopped=false 2023-07-15 19:07:18,494 INFO [Listener at localhost/45529] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:07:18,495 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 19:07:18,495 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 19:07:18,495 INFO [Listener at localhost/45529] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 19:07:18,495 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 19:07:18,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 19:07:18,495 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 19:07:18,496 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 19:07:18,496 DEBUG [Listener at localhost/45529] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08166d59 to 127.0.0.1:56639 2023-07-15 19:07:18,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 19:07:18,496 DEBUG [Listener at localhost/45529] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,496 INFO [Listener at localhost/45529] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42361,1689447991925' ***** 2023-07-15 19:07:18,496 INFO [Listener at localhost/45529] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 19:07:18,496 INFO [Listener at localhost/45529] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36223,1689447992001' ***** 2023-07-15 19:07:18,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 19:07:18,496 INFO [Listener at localhost/45529] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 19:07:18,497 INFO [Listener at localhost/45529] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42217,1689447992037' ***** 2023-07-15 19:07:18,497 INFO [Listener at localhost/45529] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 19:07:18,497 INFO [RS:0;jenkins-hbase4:42361] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 19:07:18,497 INFO [RS:1;jenkins-hbase4:36223] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 19:07:18,497 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 19:07:18,497 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 19:07:18,497 INFO [RS:1;jenkins-hbase4:36223] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 19:07:18,497 INFO [RS:1;jenkins-hbase4:36223] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 19:07:18,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 19:07:18,498 INFO [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:18,497 INFO [RS:0;jenkins-hbase4:42361] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 19:07:18,498 DEBUG [RS:1;jenkins-hbase4:36223] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ac1e54a to 127.0.0.1:56639 2023-07-15 19:07:18,497 INFO [RS:2;jenkins-hbase4:42217] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 19:07:18,498 DEBUG [RS:1;jenkins-hbase4:36223] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,498 INFO [RS:0;jenkins-hbase4:42361] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 19:07:18,499 INFO [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36223,1689447992001; all regions closed. 2023-07-15 19:07:18,499 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 19:07:18,499 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(3305): Received CLOSE for 038e0c8cc632bc70d763e000d9f72faf 2023-07-15 19:07:18,499 INFO [RS:2;jenkins-hbase4:42217] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 19:07:18,499 INFO [RS:2;jenkins-hbase4:42217] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 19:07:18,499 INFO [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:18,499 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:18,499 DEBUG [RS:2;jenkins-hbase4:42217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f4290a1 to 127.0.0.1:56639 2023-07-15 19:07:18,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 038e0c8cc632bc70d763e000d9f72faf, disabling compactions & flushes 2023-07-15 19:07:18,499 DEBUG [RS:0;jenkins-hbase4:42361] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61706be8 to 127.0.0.1:56639 2023-07-15 19:07:18,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:07:18,500 DEBUG [RS:2;jenkins-hbase4:42217] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:07:18,500 DEBUG [RS:0;jenkins-hbase4:42361] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. after waiting 0 ms 2023-07-15 19:07:18,500 INFO [RS:0;jenkins-hbase4:42361] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 19:07:18,500 INFO [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42217,1689447992037; all regions closed. 2023-07-15 19:07:18,500 INFO [RS:0;jenkins-hbase4:42361] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 19:07:18,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:07:18,500 INFO [RS:0;jenkins-hbase4:42361] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 19:07:18,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 038e0c8cc632bc70d763e000d9f72faf 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 19:07:18,500 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 19:07:18,500 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-15 19:07:18,501 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1478): Online Regions={038e0c8cc632bc70d763e000d9f72faf=hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf., 1588230740=hbase:meta,,1.1588230740} 2023-07-15 19:07:18,501 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 19:07:18,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 19:07:18,501 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 19:07:18,501 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 19:07:18,501 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 19:07:18,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=108.99 KB heapSize=178.31 KB 2023-07-15 19:07:18,501 DEBUG [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1504): Waiting on 038e0c8cc632bc70d763e000d9f72faf, 1588230740 2023-07-15 19:07:18,506 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 19:07:18,506 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 19:07:18,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf/.tmp/info/29e0ad5eba914a73acbd42c5990349f8 2023-07-15 19:07:18,530 DEBUG [RS:2;jenkins-hbase4:42217] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/oldWALs 2023-07-15 19:07:18,531 INFO [RS:2;jenkins-hbase4:42217] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42217%2C1689447992037:(num 1689447993631) 2023-07-15 19:07:18,531 DEBUG [RS:2;jenkins-hbase4:42217] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,531 INFO [RS:2;jenkins-hbase4:42217] regionserver.LeaseManager(133): Closed leases 2023-07-15 19:07:18,531 DEBUG [RS:1;jenkins-hbase4:36223] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/oldWALs 2023-07-15 19:07:18,531 INFO [RS:1;jenkins-hbase4:36223] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36223%2C1689447992001:(num 1689447993631) 2023-07-15 19:07:18,531 DEBUG [RS:1;jenkins-hbase4:36223] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,531 INFO [RS:1;jenkins-hbase4:36223] regionserver.LeaseManager(133): Closed leases 2023-07-15 19:07:18,532 INFO [RS:1;jenkins-hbase4:36223] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 19:07:18,532 INFO [RS:1;jenkins-hbase4:36223] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 19:07:18,532 INFO [RS:1;jenkins-hbase4:36223] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 19:07:18,532 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 19:07:18,532 INFO [RS:1;jenkins-hbase4:36223] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 19:07:18,532 INFO [RS:2;jenkins-hbase4:42217] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 19:07:18,534 INFO [RS:2;jenkins-hbase4:42217] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 19:07:18,534 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 19:07:18,534 INFO [RS:2;jenkins-hbase4:42217] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 19:07:18,534 INFO [RS:2;jenkins-hbase4:42217] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 19:07:18,536 INFO [RS:1;jenkins-hbase4:36223] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36223 2023-07-15 19:07:18,536 INFO [RS:2;jenkins-hbase4:42217] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42217 2023-07-15 19:07:18,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf/.tmp/info/29e0ad5eba914a73acbd42c5990349f8 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf/info/29e0ad5eba914a73acbd42c5990349f8 2023-07-15 19:07:18,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=98.74 KB at sequenceid=313 (bloomFilter=false), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/.tmp/info/7503f064546345bfa37a33b517051df4 2023-07-15 19:07:18,550 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7503f064546345bfa37a33b517051df4 2023-07-15 19:07:18,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf/info/29e0ad5eba914a73acbd42c5990349f8, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 19:07:18,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 038e0c8cc632bc70d763e000d9f72faf in 52ms, sequenceid=6, compaction requested=false 2023-07-15 19:07:18,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/namespace/038e0c8cc632bc70d763e000d9f72faf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 19:07:18,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:07:18,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 038e0c8cc632bc70d763e000d9f72faf: 2023-07-15 19:07:18,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689447994072.038e0c8cc632bc70d763e000d9f72faf. 2023-07-15 19:07:18,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.24 KB at sequenceid=313 (bloomFilter=false), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/.tmp/rep_barrier/53d10f5875f141d6a60ab696487ec818 2023-07-15 19:07:18,570 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 19:07:18,570 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 19:07:18,570 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 19:07:18,575 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53d10f5875f141d6a60ab696487ec818 2023-07-15 19:07:18,586 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=7.01 KB at sequenceid=313 (bloomFilter=false), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/.tmp/table/142f7fdd56dc4299957bcaff241ebfbb 2023-07-15 19:07:18,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 142f7fdd56dc4299957bcaff241ebfbb 2023-07-15 19:07:18,591 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/.tmp/info/7503f064546345bfa37a33b517051df4 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/info/7503f064546345bfa37a33b517051df4 2023-07-15 19:07:18,595 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7503f064546345bfa37a33b517051df4 2023-07-15 19:07:18,595 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/info/7503f064546345bfa37a33b517051df4, entries=90, sequenceid=313, filesize=13.8 K 2023-07-15 19:07:18,596 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/.tmp/rep_barrier/53d10f5875f141d6a60ab696487ec818 as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/rep_barrier/53d10f5875f141d6a60ab696487ec818 2023-07-15 19:07:18,600 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53d10f5875f141d6a60ab696487ec818 2023-07-15 19:07:18,600 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/rep_barrier/53d10f5875f141d6a60ab696487ec818, entries=33, sequenceid=313, filesize=8.2 K 2023-07-15 19:07:18,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/.tmp/table/142f7fdd56dc4299957bcaff241ebfbb as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/table/142f7fdd56dc4299957bcaff241ebfbb 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36223,1689447992001 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 19:07:18,605 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42217,1689447992037 2023-07-15 19:07:18,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 142f7fdd56dc4299957bcaff241ebfbb 2023-07-15 19:07:18,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/table/142f7fdd56dc4299957bcaff241ebfbb, entries=44, sequenceid=313, filesize=8.6 K 2023-07-15 19:07:18,607 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~108.99 KB/111604, heapSize ~178.27 KB/182544, currentSize=0 B/0 for 1588230740 in 106ms, sequenceid=313, compaction requested=false 2023-07-15 19:07:18,608 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36223,1689447992001] 2023-07-15 19:07:18,609 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36223,1689447992001; numProcessing=1 2023-07-15 19:07:18,610 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36223,1689447992001 already deleted, retry=false 2023-07-15 19:07:18,610 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36223,1689447992001 expired; onlineServers=2 2023-07-15 19:07:18,610 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42217,1689447992037] 2023-07-15 19:07:18,610 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42217,1689447992037; numProcessing=2 2023-07-15 19:07:18,611 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42217,1689447992037 already deleted, retry=false 2023-07-15 19:07:18,612 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42217,1689447992037 expired; onlineServers=1 2023-07-15 19:07:18,612 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/data/hbase/meta/1588230740/recovered.edits/316.seqid, newMaxSeqId=316, maxSeqId=1 2023-07-15 19:07:18,613 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 19:07:18,614 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 19:07:18,614 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 19:07:18,614 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 19:07:18,701 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42361,1689447991925; all regions closed. 2023-07-15 19:07:18,709 DEBUG [RS:0;jenkins-hbase4:42361] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/oldWALs 2023-07-15 19:07:18,709 INFO [RS:0;jenkins-hbase4:42361] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42361%2C1689447991925.meta:.meta(num 1689447993760) 2023-07-15 19:07:18,713 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/WALs/jenkins-hbase4.apache.org,42361,1689447991925/jenkins-hbase4.apache.org%2C42361%2C1689447991925.1689447993631 not finished, retry = 0 2023-07-15 19:07:18,815 DEBUG [RS:0;jenkins-hbase4:42361] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/oldWALs 2023-07-15 19:07:18,815 INFO [RS:0;jenkins-hbase4:42361] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42361%2C1689447991925:(num 1689447993631) 2023-07-15 19:07:18,815 DEBUG [RS:0;jenkins-hbase4:42361] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,815 INFO [RS:0;jenkins-hbase4:42361] regionserver.LeaseManager(133): Closed leases 2023-07-15 19:07:18,816 INFO [RS:0;jenkins-hbase4:42361] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 19:07:18,816 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 19:07:18,817 INFO [RS:0;jenkins-hbase4:42361] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42361 2023-07-15 19:07:18,819 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 19:07:18,820 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42361,1689447991925 2023-07-15 19:07:18,822 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42361,1689447991925] 2023-07-15 19:07:18,822 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42361,1689447991925; numProcessing=3 2023-07-15 19:07:18,823 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42361,1689447991925 already deleted, retry=false 2023-07-15 19:07:18,823 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42361,1689447991925 expired; onlineServers=0 2023-07-15 19:07:18,823 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46803,1689447990709' ***** 2023-07-15 19:07:18,823 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 19:07:18,824 DEBUG [M:0;jenkins-hbase4:46803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c27e69d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 19:07:18,824 INFO [M:0;jenkins-hbase4:46803] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46803,1689447990709 2023-07-15 19:07:18,824 INFO [M:0;jenkins-hbase4:46803] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46803,1689447990709; all regions closed. 2023-07-15 19:07:18,824 DEBUG [M:0;jenkins-hbase4:46803] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 19:07:18,824 DEBUG [M:0;jenkins-hbase4:46803] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 19:07:18,825 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 19:07:18,825 DEBUG [M:0;jenkins-hbase4:46803] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 19:07:18,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689447993244] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689447993244,5,FailOnTimeoutGroup] 2023-07-15 19:07:18,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689447993244] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689447993244,5,FailOnTimeoutGroup] 2023-07-15 19:07:18,825 INFO [M:0;jenkins-hbase4:46803] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 19:07:18,825 INFO [M:0;jenkins-hbase4:46803] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 19:07:18,825 INFO [M:0;jenkins-hbase4:46803] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 19:07:18,825 DEBUG [M:0;jenkins-hbase4:46803] master.HMaster(1512): Stopping service threads 2023-07-15 19:07:18,825 INFO [M:0;jenkins-hbase4:46803] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 19:07:18,825 ERROR [M:0;jenkins-hbase4:46803] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-15 19:07:18,826 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-15 19:07:18,826 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[IPC Client (1668759082) connection to localhost/127.0.0.1:38943 from jenkins,5,PEWorkerGroup] 2023-07-15 19:07:18,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 19:07:18,827 INFO [M:0;jenkins-hbase4:46803] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 19:07:18,827 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 19:07:18,827 DEBUG [M:0;jenkins-hbase4:46803] zookeeper.ZKUtil(398): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 19:07:18,827 WARN [M:0;jenkins-hbase4:46803] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 19:07:18,827 INFO [M:0;jenkins-hbase4:46803] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 19:07:18,827 INFO [M:0;jenkins-hbase4:46803] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 19:07:18,827 DEBUG [M:0;jenkins-hbase4:46803] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 19:07:18,827 INFO [M:0;jenkins-hbase4:46803] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 19:07:18,827 DEBUG [M:0;jenkins-hbase4:46803] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 19:07:18,827 DEBUG [M:0;jenkins-hbase4:46803] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 19:07:18,827 DEBUG [M:0;jenkins-hbase4:46803] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 19:07:18,828 INFO [M:0;jenkins-hbase4:46803] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=810.49 KB heapSize=976.92 KB 2023-07-15 19:07:18,843 INFO [M:0;jenkins-hbase4:46803] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=810.49 KB at sequenceid=1896 (bloomFilter=true), to=hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b28c283b27c348f5a293e3245103063b 2023-07-15 19:07:18,848 INFO [M:0;jenkins-hbase4:46803] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b28c283b27c348f5a293e3245103063b 2023-07-15 19:07:18,849 DEBUG [M:0;jenkins-hbase4:46803] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b28c283b27c348f5a293e3245103063b as hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b28c283b27c348f5a293e3245103063b 2023-07-15 19:07:18,853 INFO [M:0;jenkins-hbase4:46803] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b28c283b27c348f5a293e3245103063b 2023-07-15 19:07:18,853 INFO [M:0;jenkins-hbase4:46803] regionserver.HStore(1080): Added hdfs://localhost:38943/user/jenkins/test-data/b9eefab1-cc4d-853d-8259-83f0bdb55879/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b28c283b27c348f5a293e3245103063b, entries=237, sequenceid=1896, filesize=39.0 K 2023-07-15 19:07:18,855 INFO [M:0;jenkins-hbase4:46803] regionserver.HRegion(2948): Finished flush of dataSize ~810.49 KB/829942, heapSize ~976.91 KB/1000352, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=1896, compaction requested=false 2023-07-15 19:07:18,855 INFO [M:0;jenkins-hbase4:46803] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 19:07:18,855 DEBUG [M:0;jenkins-hbase4:46803] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 19:07:18,861 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 19:07:18,861 INFO [M:0;jenkins-hbase4:46803] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 19:07:18,862 INFO [M:0;jenkins-hbase4:46803] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46803 2023-07-15 19:07:18,865 DEBUG [M:0;jenkins-hbase4:46803] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46803,1689447990709 already deleted, retry=false 2023-07-15 19:07:18,996 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 19:07:18,996 INFO [M:0;jenkins-hbase4:46803] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46803,1689447990709; zookeeper connection closed. 2023-07-15 19:07:18,996 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): master:46803-0x1016a6105630000, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 19:07:19,096 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 19:07:19,096 INFO [RS:0;jenkins-hbase4:42361] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42361,1689447991925; zookeeper connection closed. 2023-07-15 19:07:19,096 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42361-0x1016a6105630001, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 19:07:19,097 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@32edde29] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@32edde29 2023-07-15 19:07:19,196 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 19:07:19,197 INFO [RS:2;jenkins-hbase4:42217] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42217,1689447992037; zookeeper connection closed. 2023-07-15 19:07:19,197 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:42217-0x1016a6105630003, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 19:07:19,197 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@8987524] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@8987524 2023-07-15 19:07:19,297 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 19:07:19,297 INFO [RS:1;jenkins-hbase4:36223] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36223,1689447992001; zookeeper connection closed. 2023-07-15 19:07:19,297 DEBUG [Listener at localhost/45529-EventThread] zookeeper.ZKWatcher(600): regionserver:36223-0x1016a6105630002, quorum=127.0.0.1:56639, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 19:07:19,297 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7467bcab] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7467bcab 2023-07-15 19:07:19,297 INFO [Listener at localhost/45529] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 19:07:19,298 WARN [Listener at localhost/45529] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 19:07:19,303 INFO [Listener at localhost/45529] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 19:07:19,304 WARN [1709947977@qtp-1417988735-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44307] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-15 19:07:19,304 WARN [1709947977@qtp-1417988735-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44307] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-15 19:07:19,407 WARN [BP-335825283-172.31.14.131-1689447987257 heartbeating to localhost/127.0.0.1:38943] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 19:07:19,407 WARN [BP-335825283-172.31.14.131-1689447987257 heartbeating to localhost/127.0.0.1:38943] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-335825283-172.31.14.131-1689447987257 (Datanode Uuid 71de83e6-e4cd-4796-9d0e-35edc6cf495f) service to localhost/127.0.0.1:38943 2023-07-15 19:07:19,408 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data5/current/BP-335825283-172.31.14.131-1689447987257] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 19:07:19,409 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data6/current/BP-335825283-172.31.14.131-1689447987257] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 19:07:19,411 WARN [Listener at localhost/45529] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 19:07:19,413 INFO [Listener at localhost/45529] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 19:07:19,516 WARN [BP-335825283-172.31.14.131-1689447987257 heartbeating to localhost/127.0.0.1:38943] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 19:07:19,516 WARN [BP-335825283-172.31.14.131-1689447987257 heartbeating to localhost/127.0.0.1:38943] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-335825283-172.31.14.131-1689447987257 (Datanode Uuid 4dc9e269-177d-4e3e-aab5-02c1ab07e254) service to localhost/127.0.0.1:38943 2023-07-15 19:07:19,516 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data3/current/BP-335825283-172.31.14.131-1689447987257] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 19:07:19,517 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data4/current/BP-335825283-172.31.14.131-1689447987257] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 19:07:19,518 WARN [Listener at localhost/45529] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 19:07:19,520 INFO [Listener at localhost/45529] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 19:07:19,624 WARN [BP-335825283-172.31.14.131-1689447987257 heartbeating to localhost/127.0.0.1:38943] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 19:07:19,624 WARN [BP-335825283-172.31.14.131-1689447987257 heartbeating to localhost/127.0.0.1:38943] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-335825283-172.31.14.131-1689447987257 (Datanode Uuid 787371eb-efe3-4cd5-9440-0f165e59ce52) service to localhost/127.0.0.1:38943 2023-07-15 19:07:19,624 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data1/current/BP-335825283-172.31.14.131-1689447987257] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 19:07:19,625 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/d5c001bd-bef2-9269-7e29-3604d44238e3/cluster_f69bc24c-d800-bf08-5cf2-a955087a4549/dfs/data/data2/current/BP-335825283-172.31.14.131-1689447987257] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 19:07:19,646 INFO [Listener at localhost/45529] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 19:07:19,774 INFO [Listener at localhost/45529] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 19:07:19,853 INFO [Listener at localhost/45529] hbase.HBaseTestingUtility(1293): Minicluster is down