2023-07-22 20:17:35,155 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2 2023-07-22 20:17:35,265 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestQuotasShell timeout: 13 mins 2023-07-22 20:17:35,385 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-22 20:17:35,509 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-22 20:17:35,510 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/cluster_9554e79a-d920-85e6-3f8e-f0796f7f4da8, deleteOnExit=true 2023-07-22 20:17:35,510 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-22 20:17:35,511 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/test.cache.data in system properties and HBase conf 2023-07-22 20:17:35,512 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 20:17:35,512 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/hadoop.log.dir in system properties and HBase conf 2023-07-22 20:17:35,513 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 20:17:35,513 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 20:17:35,513 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 20:17:35,820 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-22 20:17:35,826 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 20:17:35,826 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 20:17:35,826 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 20:17:35,827 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 20:17:35,827 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 20:17:35,827 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 20:17:35,827 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 20:17:35,828 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 20:17:35,828 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 20:17:35,828 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/nfs.dump.dir in system properties and HBase conf 2023-07-22 20:17:35,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/java.io.tmpdir in system properties and HBase conf 2023-07-22 20:17:35,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 20:17:35,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 20:17:35,830 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-22 20:17:36,320 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 20:17:36,324 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 20:17:36,594 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-22 20:17:36,750 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-22 20:17:36,765 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 20:17:36,801 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 20:17:36,836 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/java.io.tmpdir/Jetty_localhost_45127_hdfs____mux2gv/webapp 2023-07-22 20:17:36,984 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45127 2023-07-22 20:17:37,004 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 20:17:37,004 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 20:17:37,568 WARN [Listener at localhost/35725] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 20:17:37,719 WARN [Listener at localhost/35725] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 20:17:37,743 WARN [Listener at localhost/35725] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 20:17:37,751 INFO [Listener at localhost/35725] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 20:17:37,758 INFO [Listener at localhost/35725] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/java.io.tmpdir/Jetty_localhost_46699_datanode____.6uifwl/webapp 2023-07-22 20:17:37,863 INFO [Listener at localhost/35725] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46699 2023-07-22 20:17:38,106 WARN [Listener at localhost/40721] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 20:17:38,546 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5cd2b0302443e344: Processing first storage report for DS-08dbc7a2-363d-4aca-961e-318d97759ba3 from datanode 35cce8cb-9370-4e5c-8b1c-2574ef853915 2023-07-22 20:17:38,547 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5cd2b0302443e344: from storage DS-08dbc7a2-363d-4aca-961e-318d97759ba3 node DatanodeRegistration(127.0.0.1:45239, datanodeUuid=35cce8cb-9370-4e5c-8b1c-2574ef853915, infoPort=36013, infoSecurePort=0, ipcPort=40721, storageInfo=lv=-57;cid=testClusterID;nsid=1285022139;c=1690057056392), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 20:17:38,547 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5cd2b0302443e344: Processing first storage report for DS-fe80f8ef-92ab-4630-9ac5-2c6790ce3a0f from datanode 35cce8cb-9370-4e5c-8b1c-2574ef853915 2023-07-22 20:17:38,548 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5cd2b0302443e344: from storage DS-fe80f8ef-92ab-4630-9ac5-2c6790ce3a0f node DatanodeRegistration(127.0.0.1:45239, datanodeUuid=35cce8cb-9370-4e5c-8b1c-2574ef853915, infoPort=36013, infoSecurePort=0, ipcPort=40721, storageInfo=lv=-57;cid=testClusterID;nsid=1285022139;c=1690057056392), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 20:17:38,550 DEBUG [Listener at localhost/40721] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2 2023-07-22 20:17:38,618 INFO [Listener at localhost/40721] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/cluster_9554e79a-d920-85e6-3f8e-f0796f7f4da8/zookeeper_0, clientPort=61246, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/cluster_9554e79a-d920-85e6-3f8e-f0796f7f4da8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/cluster_9554e79a-d920-85e6-3f8e-f0796f7f4da8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-22 20:17:38,632 INFO [Listener at localhost/40721] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61246 2023-07-22 20:17:38,643 INFO [Listener at localhost/40721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 20:17:38,645 INFO [Listener at localhost/40721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 20:17:39,319 INFO [Listener at localhost/40721] util.FSUtils(471): Created version file at hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970 with version=8 2023-07-22 20:17:39,320 INFO [Listener at localhost/40721] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/hbase-staging 2023-07-22 20:17:39,337 DEBUG [Listener at localhost/40721] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-22 20:17:39,337 DEBUG [Listener at localhost/40721] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-22 20:17:39,691 INFO [Listener at localhost/40721] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-22 20:17:40,259 INFO [Listener at localhost/40721] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=18 2023-07-22 20:17:40,294 INFO [Listener at localhost/40721] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 20:17:40,294 INFO [Listener at localhost/40721] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 20:17:40,295 INFO [Listener at localhost/40721] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 20:17:40,295 INFO [Listener at localhost/40721] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 20:17:40,295 INFO [Listener at localhost/40721] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 20:17:40,452 INFO [Listener at localhost/40721] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 20:17:40,527 DEBUG [Listener at localhost/40721] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-22 20:17:40,630 INFO [Listener at localhost/40721] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41649 2023-07-22 20:17:40,645 INFO [Listener at localhost/40721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 20:17:40,647 INFO [Listener at localhost/40721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 20:17:40,670 INFO [Listener at localhost/40721] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41649 connecting to ZooKeeper ensemble=127.0.0.1:61246 2023-07-22 20:17:40,711 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:416490x0, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 20:17:40,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41649-0x1018eaeac2f0000 connected 2023-07-22 20:17:40,753 DEBUG [Listener at localhost/40721] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 20:17:40,754 DEBUG [Listener at localhost/40721] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 20:17:40,769 DEBUG [Listener at localhost/40721] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 20:17:40,779 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41649 2023-07-22 20:17:40,779 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41649 2023-07-22 20:17:40,780 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41649 2023-07-22 20:17:40,782 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41649 2023-07-22 20:17:40,782 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41649 2023-07-22 20:17:40,825 INFO [Listener at localhost/40721] log.Log(170): Logging initialized @6299ms to org.apache.hbase.thirdparty.org.eclipse.jetty.util.log.Slf4jLog 2023-07-22 20:17:40,961 INFO [Listener at localhost/40721] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-22 20:17:40,961 INFO [Listener at localhost/40721] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-22 20:17:40,962 INFO [Listener at localhost/40721] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-22 20:17:40,964 INFO [Listener at localhost/40721] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-22 20:17:40,964 INFO [Listener at localhost/40721] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-22 20:17:40,964 INFO [Listener at localhost/40721] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-22 20:17:40,968 INFO [Listener at localhost/40721] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-22 20:17:41,030 INFO [Listener at localhost/40721] http.HttpServer(1146): Jetty bound to port 45959 2023-07-22 20:17:41,031 INFO [Listener at localhost/40721] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-22 20:17:41,058 INFO [Listener at localhost/40721] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-22 20:17:41,061 INFO [Listener at localhost/40721] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2c4dd569{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/hadoop.log.dir/,AVAILABLE} 2023-07-22 20:17:41,062 INFO [Listener at localhost/40721] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-22 20:17:41,062 INFO [Listener at localhost/40721] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@67c0cb70{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-22 20:17:41,260 INFO [Listener at localhost/40721] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-22 20:17:41,272 INFO [Listener at localhost/40721] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-22 20:17:41,272 INFO [Listener at localhost/40721] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-22 20:17:41,274 INFO [Listener at localhost/40721] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-22 20:17:41,281 INFO [Listener at localhost/40721] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-22 20:17:41,308 INFO [Listener at localhost/40721] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@11069379{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/java.io.tmpdir/jetty-0_0_0_0-45959-hbase-server-2_4_18-SNAPSHOT_jar-_-any-6550811233993313655/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-22 20:17:41,319 INFO [Listener at localhost/40721] server.AbstractConnector(333): Started ServerConnector@693001fb{HTTP/1.1, (http/1.1)}{0.0.0.0:45959} 2023-07-22 20:17:41,320 INFO [Listener at localhost/40721] server.Server(415): Started @6794ms 2023-07-22 20:17:41,323 INFO [Listener at localhost/40721] master.HMaster(444): hbase.rootdir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970, hbase.cluster.distributed=false 2023-07-22 20:17:41,383 INFO [Listener at localhost/40721] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=18 2023-07-22 20:17:41,383 INFO [Listener at localhost/40721] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 20:17:41,383 INFO [Listener at localhost/40721] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 20:17:41,384 INFO [Listener at localhost/40721] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 20:17:41,384 INFO [Listener at localhost/40721] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 20:17:41,384 INFO [Listener at localhost/40721] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 20:17:41,388 INFO [Listener at localhost/40721] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 20:17:41,391 INFO [Listener at localhost/40721] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42833 2023-07-22 20:17:41,394 INFO [Listener at localhost/40721] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 20:17:41,401 DEBUG [Listener at localhost/40721] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 20:17:41,402 INFO [Listener at localhost/40721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 20:17:41,404 INFO [Listener at localhost/40721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 20:17:41,406 INFO [Listener at localhost/40721] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42833 connecting to ZooKeeper ensemble=127.0.0.1:61246 2023-07-22 20:17:41,411 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:428330x0, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 20:17:41,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42833-0x1018eaeac2f0001 connected 2023-07-22 20:17:41,412 DEBUG [Listener at localhost/40721] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 20:17:41,414 DEBUG [Listener at localhost/40721] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 20:17:41,415 DEBUG [Listener at localhost/40721] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 20:17:41,415 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42833 2023-07-22 20:17:41,416 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42833 2023-07-22 20:17:41,416 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42833 2023-07-22 20:17:41,417 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42833 2023-07-22 20:17:41,417 DEBUG [Listener at localhost/40721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42833 2023-07-22 20:17:41,420 INFO [Listener at localhost/40721] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-22 20:17:41,421 INFO [Listener at localhost/40721] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-22 20:17:41,421 INFO [Listener at localhost/40721] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-22 20:17:41,422 INFO [Listener at localhost/40721] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-22 20:17:41,422 INFO [Listener at localhost/40721] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-22 20:17:41,422 INFO [Listener at localhost/40721] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-22 20:17:41,422 INFO [Listener at localhost/40721] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-22 20:17:41,425 INFO [Listener at localhost/40721] http.HttpServer(1146): Jetty bound to port 42409 2023-07-22 20:17:41,425 INFO [Listener at localhost/40721] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-22 20:17:41,426 INFO [Listener at localhost/40721] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-22 20:17:41,427 INFO [Listener at localhost/40721] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2ce9c0a0{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/hadoop.log.dir/,AVAILABLE} 2023-07-22 20:17:41,427 INFO [Listener at localhost/40721] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-22 20:17:41,427 INFO [Listener at localhost/40721] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@6234eb75{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-22 20:17:41,549 INFO [Listener at localhost/40721] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-22 20:17:41,551 INFO [Listener at localhost/40721] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-22 20:17:41,551 INFO [Listener at localhost/40721] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-22 20:17:41,552 INFO [Listener at localhost/40721] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-22 20:17:41,553 INFO [Listener at localhost/40721] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-22 20:17:41,557 INFO [Listener at localhost/40721] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@7d263fa9{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/java.io.tmpdir/jetty-0_0_0_0-42409-hbase-server-2_4_18-SNAPSHOT_jar-_-any-68016643465549735/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-22 20:17:41,559 INFO [Listener at localhost/40721] server.AbstractConnector(333): Started ServerConnector@1c0828f9{HTTP/1.1, (http/1.1)}{0.0.0.0:42409} 2023-07-22 20:17:41,559 INFO [Listener at localhost/40721] server.Server(415): Started @7033ms 2023-07-22 20:17:41,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-22 20:17:41,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@6e979980{HTTP/1.1, (http/1.1)}{0.0.0.0:37077} 2023-07-22 20:17:41,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(415): Started @7043ms 2023-07-22 20:17:41,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:17:41,578 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 20:17:41,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:17:41,599 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 20:17:41,599 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 20:17:41,599 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:41,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 20:17:41,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41649,1690057059500 from backup master directory 2023-07-22 20:17:41,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 20:17:41,604 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:17:41,604 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 20:17:41,605 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 20:17:41,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:17:41,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-22 20:17:41,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-22 20:17:41,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/hbase.id with ID: b210b079-803d-40c8-9544-d8b6435b7aca 2023-07-22 20:17:41,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 20:17:41,755 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:41,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5a42da7c to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:41,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d62aa50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:41,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 20:17:41,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-22 20:17:41,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-22 20:17:41,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-22 20:17:41,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 20:17:41,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 20:17:41,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 20:17:41,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store-tmp 2023-07-22 20:17:41,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:41,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 20:17:41,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 20:17:41,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 20:17:41,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 20:17:41,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 20:17:41,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 20:17:41,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 20:17:41,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/WALs/jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:17:41,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41649%2C1690057059500, suffix=, logDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/WALs/jenkins-hbase4.apache.org,41649,1690057059500, archiveDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/oldWALs, maxLogs=10 2023-07-22 20:17:42,043 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45239,DS-08dbc7a2-363d-4aca-961e-318d97759ba3,DISK] 2023-07-22 20:17:42,051 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-22 20:17:42,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/WALs/jenkins-hbase4.apache.org,41649,1690057059500/jenkins-hbase4.apache.org%2C41649%2C1690057059500.1690057062000 2023-07-22 20:17:42,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45239,DS-08dbc7a2-363d-4aca-961e-318d97759ba3,DISK]] 2023-07-22 20:17:42,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-22 20:17:42,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:42,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 20:17:42,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 20:17:42,189 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-22 20:17:42,202 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-22 20:17:42,262 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-22 20:17:42,274 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:42,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 20:17:42,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 20:17:42,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 20:17:42,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 20:17:42,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11561381120, jitterRate=0.07673752307891846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 20:17:42,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 20:17:42,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-22 20:17:42,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-22 20:17:42,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-22 20:17:42,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-22 20:17:42,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-22 20:17:42,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 37 msec 2023-07-22 20:17:42,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-22 20:17:42,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-22 20:17:42,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-22 20:17:42,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-22 20:17:42,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-22 20:17:42,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-22 20:17:42,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-22 20:17:42,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-22 20:17:42,460 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:42,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-22 20:17:42,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-22 20:17:42,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-22 20:17:42,486 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 20:17:42,486 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 20:17:42,486 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:42,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41649,1690057059500, sessionid=0x1018eaeac2f0000, setting cluster-up flag (Was=false) 2023-07-22 20:17:42,509 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:42,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-22 20:17:42,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:17:42,522 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:42,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-22 20:17:42,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:17:42,533 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp 2023-07-22 20:17:42,563 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(951): ClusterId : b210b079-803d-40c8-9544-d8b6435b7aca 2023-07-22 20:17:42,569 DEBUG [RS:0;jenkins-hbase4:42833] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 20:17:42,575 DEBUG [RS:0;jenkins-hbase4:42833] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 20:17:42,575 DEBUG [RS:0;jenkins-hbase4:42833] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 20:17:42,579 DEBUG [RS:0;jenkins-hbase4:42833] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 20:17:42,580 DEBUG [RS:0;jenkins-hbase4:42833] zookeeper.ReadOnlyZKClient(139): Connect 0x53f6f962 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:42,585 DEBUG [RS:0;jenkins-hbase4:42833] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2efcdf0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:42,586 DEBUG [RS:0;jenkins-hbase4:42833] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b732ce2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 20:17:42,622 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42833 2023-07-22 20:17:42,627 INFO [RS:0;jenkins-hbase4:42833] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 20:17:42,628 INFO [RS:0;jenkins-hbase4:42833] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 20:17:42,631 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 20:17:42,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-22 20:17:42,632 INFO [RS:0;jenkins-hbase4:42833] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 20:17:42,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 20:17:42,633 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 20:17:42,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-22 20:17:42,637 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41649,1690057059500 with isa=jenkins-hbase4.apache.org/172.31.14.131:42833, startcode=1690057061382 2023-07-22 20:17:42,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=VisibilityLabelsService 2023-07-22 20:17:42,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870913. 2023-07-22 20:17:42,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870914. 2023-07-22 20:17:42,656 DEBUG [RS:0;jenkins-hbase4:42833] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 20:17:42,710 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36633, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 20:17:42,719 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41649] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 20:17:42,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-22 20:17:42,747 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 20:17:42,747 WARN [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 20:17:42,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 20:17:42,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 20:17:42,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 20:17:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 20:17:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-22 20:17:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 20:17:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690057092757 2023-07-22 20:17:42,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-22 20:17:42,763 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 20:17:42,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-22 20:17:42,764 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-22 20:17:42,770 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 20:17:42,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-22 20:17:42,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-22 20:17:42,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-22 20:17:42,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-22 20:17:42,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-22 20:17:42,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-22 20:17:42,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-22 20:17:42,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-22 20:17:42,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-22 20:17:42,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690057062781,5,FailOnTimeoutGroup] 2023-07-22 20:17:42,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690057062781,5,FailOnTimeoutGroup] 2023-07-22 20:17:42,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-22 20:17:42,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,848 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41649,1690057059500 with isa=jenkins-hbase4.apache.org/172.31.14.131:42833, startcode=1690057061382 2023-07-22 20:17:42,854 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41649] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:42,860 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970 2023-07-22 20:17:42,860 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35725 2023-07-22 20:17:42,860 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=45959 2023-07-22 20:17:42,868 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 20:17:42,869 DEBUG [RS:0;jenkins-hbase4:42833] zookeeper.ZKUtil(162): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:42,869 WARN [RS:0;jenkins-hbase4:42833] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 20:17:42,870 INFO [RS:0;jenkins-hbase4:42833] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 20:17:42,870 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/WALs/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:42,871 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42833,1690057061382] 2023-07-22 20:17:42,879 DEBUG [RS:0;jenkins-hbase4:42833] zookeeper.ZKUtil(162): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:42,891 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 20:17:42,900 INFO [RS:0;jenkins-hbase4:42833] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 20:17:42,920 INFO [RS:0;jenkins-hbase4:42833] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 20:17:42,924 INFO [RS:0;jenkins-hbase4:42833] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 20:17:42,924 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,925 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 20:17:42,934 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,934 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,934 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,935 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,935 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,935 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,935 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 20:17:42,935 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,935 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,935 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,935 DEBUG [RS:0;jenkins-hbase4:42833] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 20:17:42,936 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,936 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,936 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,936 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,954 INFO [RS:0;jenkins-hbase4:42833] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 20:17:42,957 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42833,1690057061382-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,976 INFO [RS:0;jenkins-hbase4:42833] regionserver.Replication(203): jenkins-hbase4.apache.org,42833,1690057061382 started 2023-07-22 20:17:42,977 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42833,1690057061382, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42833, sessionid=0x1018eaeac2f0001 2023-07-22 20:17:42,977 DEBUG [RS:0;jenkins-hbase4:42833] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 20:17:42,977 DEBUG [RS:0;jenkins-hbase4:42833] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:42,977 DEBUG [RS:0;jenkins-hbase4:42833] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42833,1690057061382' 2023-07-22 20:17:42,977 DEBUG [RS:0;jenkins-hbase4:42833] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 20:17:42,978 DEBUG [RS:0;jenkins-hbase4:42833] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 20:17:42,978 DEBUG [RS:0;jenkins-hbase4:42833] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 20:17:42,978 DEBUG [RS:0;jenkins-hbase4:42833] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 20:17:42,978 DEBUG [RS:0;jenkins-hbase4:42833] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:42,978 DEBUG [RS:0;jenkins-hbase4:42833] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42833,1690057061382' 2023-07-22 20:17:42,978 DEBUG [RS:0;jenkins-hbase4:42833] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 20:17:42,979 DEBUG [RS:0;jenkins-hbase4:42833] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 20:17:42,979 DEBUG [RS:0;jenkins-hbase4:42833] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 20:17:42,979 INFO [RS:0;jenkins-hbase4:42833] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-22 20:17:42,981 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,982 DEBUG [RS:0;jenkins-hbase4:42833] zookeeper.ZKUtil(398): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-22 20:17:42,982 INFO [RS:0;jenkins-hbase4:42833] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-22 20:17:42,983 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:42,983 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:43,095 INFO [RS:0;jenkins-hbase4:42833] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42833%2C1690057061382, suffix=, logDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/WALs/jenkins-hbase4.apache.org,42833,1690057061382, archiveDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/oldWALs, maxLogs=32 2023-07-22 20:17:43,113 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45239,DS-08dbc7a2-363d-4aca-961e-318d97759ba3,DISK] 2023-07-22 20:17:43,117 INFO [RS:0;jenkins-hbase4:42833] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/WALs/jenkins-hbase4.apache.org,42833,1690057061382/jenkins-hbase4.apache.org%2C42833%2C1690057061382.1690057063098 2023-07-22 20:17:43,117 DEBUG [RS:0;jenkins-hbase4:42833] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45239,DS-08dbc7a2-363d-4aca-961e-318d97759ba3,DISK]] 2023-07-22 20:17:43,205 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 20:17:43,207 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 20:17:43,207 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970 2023-07-22 20:17:43,222 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:43,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 20:17:43,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/info 2023-07-22 20:17:43,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 20:17:43,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:43,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 20:17:43,231 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/rep_barrier 2023-07-22 20:17:43,232 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 20:17:43,233 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:43,233 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 20:17:43,235 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/table 2023-07-22 20:17:43,236 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 20:17:43,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:43,238 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740 2023-07-22 20:17:43,239 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740 2023-07-22 20:17:43,243 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 20:17:43,245 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 20:17:43,249 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 20:17:43,251 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11543253120, jitterRate=0.07504922151565552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 20:17:43,251 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 20:17:43,251 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 20:17:43,251 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 20:17:43,251 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 20:17:43,251 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 20:17:43,251 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 20:17:43,252 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 20:17:43,253 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 20:17:43,258 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 20:17:43,258 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-22 20:17:43,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-22 20:17:43,281 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-22 20:17:43,283 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-22 20:17:43,435 DEBUG [jenkins-hbase4:41649] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-22 20:17:43,438 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42833,1690057061382, state=OPENING 2023-07-22 20:17:43,446 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-22 20:17:43,447 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:43,448 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 20:17:43,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42833,1690057061382}] 2023-07-22 20:17:43,636 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:43,638 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 20:17:43,642 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 20:17:43,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-22 20:17:43,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 20:17:43,656 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42833%2C1690057061382.meta, suffix=.meta, logDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/WALs/jenkins-hbase4.apache.org,42833,1690057061382, archiveDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/oldWALs, maxLogs=32 2023-07-22 20:17:43,672 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45239,DS-08dbc7a2-363d-4aca-961e-318d97759ba3,DISK] 2023-07-22 20:17:43,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/WALs/jenkins-hbase4.apache.org,42833,1690057061382/jenkins-hbase4.apache.org%2C42833%2C1690057061382.meta.1690057063658.meta 2023-07-22 20:17:43,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45239,DS-08dbc7a2-363d-4aca-961e-318d97759ba3,DISK]] 2023-07-22 20:17:43,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-22 20:17:43,677 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-22 20:17:43,679 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 20:17:43,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=VisibilityLabelsService 2023-07-22 20:17:43,684 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-22 20:17:43,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-22 20:17:43,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-22 20:17:43,687 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-22 20:17:43,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-22 20:17:43,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:43,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-22 20:17:43,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-22 20:17:43,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 20:17:43,705 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/info 2023-07-22 20:17:43,706 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/info 2023-07-22 20:17:43,706 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 20:17:43,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:43,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 20:17:43,709 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/rep_barrier 2023-07-22 20:17:43,709 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/rep_barrier 2023-07-22 20:17:43,709 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 20:17:43,710 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:43,710 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 20:17:43,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/table 2023-07-22 20:17:43,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/table 2023-07-22 20:17:43,712 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 20:17:43,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:43,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740 2023-07-22 20:17:43,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740 2023-07-22 20:17:43,721 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 20:17:43,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 20:17:43,725 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11663025600, jitterRate=0.08620390295982361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 20:17:43,734 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:43,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 20:17:43,756 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690057063628 2023-07-22 20:17:43,774 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-22 20:17:43,775 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-22 20:17:43,776 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42833,1690057061382, state=OPEN 2023-07-22 20:17:43,782 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-22 20:17:43,782 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 20:17:43,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-22 20:17:43,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42833,1690057061382 in 331 msec 2023-07-22 20:17:43,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-22 20:17:43,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 520 msec 2023-07-22 20:17:43,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1430 sec 2023-07-22 20:17:43,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690057063796, completionTime=-1 2023-07-22 20:17:43,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-22 20:17:43,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-22 20:17:43,868 DEBUG [hconnection-0x6c1f032b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:43,872 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:43,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-22 20:17:43,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690057123897 2023-07-22 20:17:43,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690057183898 2023-07-22 20:17:43,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 100 msec 2023-07-22 20:17:43,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41649,1690057059500-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:43,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41649,1690057059500-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:43,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41649,1690057059500-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:43,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41649, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:43,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:43,930 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-22 20:17:43,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-22 20:17:43,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 20:17:43,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-22 20:17:43,952 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 20:17:43,955 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 20:17:43,976 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:43,980 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699 empty. 2023-07-22 20:17:43,981 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:43,981 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-22 20:17:44,002 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-22 20:17:44,005 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ece6ce984aff03a55850b79f120f699, NAME => 'hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp 2023-07-22 20:17:44,016 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:44,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7ece6ce984aff03a55850b79f120f699, disabling compactions & flushes 2023-07-22 20:17:44,017 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:17:44,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:17:44,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. after waiting 0 ms 2023-07-22 20:17:44,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:17:44,017 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:17:44,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7ece6ce984aff03a55850b79f120f699: 2023-07-22 20:17:44,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 20:17:44,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690057064025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690057064025"}]},"ts":"1690057064025"} 2023-07-22 20:17:44,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 20:17:44,073 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 20:17:44,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057064073"}]},"ts":"1690057064073"} 2023-07-22 20:17:44,084 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-22 20:17:44,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7ece6ce984aff03a55850b79f120f699, ASSIGN}] 2023-07-22 20:17:44,093 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7ece6ce984aff03a55850b79f120f699, ASSIGN 2023-07-22 20:17:44,095 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7ece6ce984aff03a55850b79f120f699, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42833,1690057061382; forceNewPlan=false, retain=false 2023-07-22 20:17:44,246 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7ece6ce984aff03a55850b79f120f699, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:44,247 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690057064246"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690057064246"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690057064246"}]},"ts":"1690057064246"} 2023-07-22 20:17:44,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7ece6ce984aff03a55850b79f120f699, server=jenkins-hbase4.apache.org,42833,1690057061382}] 2023-07-22 20:17:44,411 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:17:44,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ece6ce984aff03a55850b79f120f699, NAME => 'hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699.', STARTKEY => '', ENDKEY => ''} 2023-07-22 20:17:44,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. service=AccessControlService 2023-07-22 20:17:44,413 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 20:17:44,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. service=VisibilityLabelsService 2023-07-22 20:17:44,414 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-22 20:17:44,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:44,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:44,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:44,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:44,417 INFO [StoreOpener-7ece6ce984aff03a55850b79f120f699-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:44,419 DEBUG [StoreOpener-7ece6ce984aff03a55850b79f120f699-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699/info 2023-07-22 20:17:44,419 DEBUG [StoreOpener-7ece6ce984aff03a55850b79f120f699-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699/info 2023-07-22 20:17:44,420 INFO [StoreOpener-7ece6ce984aff03a55850b79f120f699-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ece6ce984aff03a55850b79f120f699 columnFamilyName info 2023-07-22 20:17:44,420 INFO [StoreOpener-7ece6ce984aff03a55850b79f120f699-1] regionserver.HStore(310): Store=7ece6ce984aff03a55850b79f120f699/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:44,422 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:44,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:44,428 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ece6ce984aff03a55850b79f120f699 2023-07-22 20:17:44,432 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 20:17:44,433 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ece6ce984aff03a55850b79f120f699; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10313398720, jitterRate=-0.03948989510536194}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 20:17:44,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ece6ce984aff03a55850b79f120f699: 2023-07-22 20:17:44,436 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699., pid=6, masterSystemTime=1690057064405 2023-07-22 20:17:44,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:17:44,441 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:17:44,442 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7ece6ce984aff03a55850b79f120f699, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:44,442 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690057064441"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690057064441"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690057064441"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690057064441"}]},"ts":"1690057064441"} 2023-07-22 20:17:44,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-22 20:17:44,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7ece6ce984aff03a55850b79f120f699, server=jenkins-hbase4.apache.org,42833,1690057061382 in 196 msec 2023-07-22 20:17:44,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-22 20:17:44,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7ece6ce984aff03a55850b79f120f699, ASSIGN in 359 msec 2023-07-22 20:17:44,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 20:17:44,456 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057064456"}]},"ts":"1690057064456"} 2023-07-22 20:17:44,458 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-22 20:17:44,462 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 20:17:44,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 521 msec 2023-07-22 20:17:44,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-22 20:17:44,554 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-22 20:17:44,554 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:44,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-22 20:17:44,613 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 20:17:44,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-07-22 20:17:44,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-22 20:17:44,644 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 20:17:44,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-22 20:17:44,658 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-22 20:17:44,661 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-22 20:17:44,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.055sec 2023-07-22 20:17:44,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2023-07-22 20:17:44,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 20:17:44,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2023-07-22 20:17:44,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2023-07-22 20:17:44,668 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 20:17:44,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2023-07-22 20:17:44,670 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 20:17:44,670 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x1fff9076 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:44,679 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52853975, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:44,679 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:44,680 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455 empty. 2023-07-22 20:17:44,684 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:44,684 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2023-07-22 20:17:44,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2023-07-22 20:17:44,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2023-07-22 20:17:44,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:44,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 20:17:44,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-22 20:17:44,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-22 20:17:44,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41649,1690057059500-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-22 20:17:44,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41649,1690057059500-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-22 20:17:44,699 DEBUG [hconnection-0x38fb966d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:44,724 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2023-07-22 20:17:44,726 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:44,729 INFO [Listener at localhost/40721] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:17:44,729 DEBUG [Listener at localhost/40721] client.AbstractTestShell(63): Configure jruby runtime, cluster set to org.apache.hadoop.hbase.HBaseTestingUtility@798325ed 2023-07-22 20:17:44,731 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => aee51ac7fd428f2b02d86170b5fad455, NAME => 'hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp 2023-07-22 20:17:44,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 20:17:44,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-22 20:17:44,745 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 20:17:44,747 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 20:17:44,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 10 2023-07-22 20:17:44,753 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:44,754 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818 empty. 2023-07-22 20:17:44,761 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:44,761 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-22 20:17:44,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-22 20:17:44,772 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:44,772 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing aee51ac7fd428f2b02d86170b5fad455, disabling compactions & flushes 2023-07-22 20:17:44,772 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:17:44,772 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:17:44,772 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. after waiting 0 ms 2023-07-22 20:17:44,772 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:17:44,772 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:17:44,773 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for aee51ac7fd428f2b02d86170b5fad455: 2023-07-22 20:17:44,778 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 20:17:44,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1690057064790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690057064790"}]},"ts":"1690057064790"} 2023-07-22 20:17:44,794 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 20:17:44,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 20:17:44,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057064795"}]},"ts":"1690057064795"} 2023-07-22 20:17:44,798 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2023-07-22 20:17:44,798 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-22 20:17:44,800 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => e39f88ae0f2b248ee9cc38d588346818, NAME => 'hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp 2023-07-22 20:17:44,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=aee51ac7fd428f2b02d86170b5fad455, ASSIGN}] 2023-07-22 20:17:44,815 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=aee51ac7fd428f2b02d86170b5fad455, ASSIGN 2023-07-22 20:17:44,819 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=aee51ac7fd428f2b02d86170b5fad455, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42833,1690057061382; forceNewPlan=false, retain=false 2023-07-22 20:17:44,978 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aee51ac7fd428f2b02d86170b5fad455, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:44,979 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1690057064978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690057064978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690057064978"}]},"ts":"1690057064978"} 2023-07-22 20:17:44,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure aee51ac7fd428f2b02d86170b5fad455, server=jenkins-hbase4.apache.org,42833,1690057061382}] 2023-07-22 20:17:45,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-22 20:17:45,145 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:17:45,145 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aee51ac7fd428f2b02d86170b5fad455, NAME => 'hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455.', STARTKEY => '', ENDKEY => ''} 2023-07-22 20:17:45,145 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. service=AccessControlService 2023-07-22 20:17:45,146 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 20:17:45,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. service=VisibilityLabelsService 2023-07-22 20:17:45,146 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-22 20:17:45,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:45,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:45,147 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:45,147 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:45,149 INFO [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:45,151 DEBUG [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/q 2023-07-22 20:17:45,152 DEBUG [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/q 2023-07-22 20:17:45,152 INFO [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aee51ac7fd428f2b02d86170b5fad455 columnFamilyName q 2023-07-22 20:17:45,153 INFO [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] regionserver.HStore(310): Store=aee51ac7fd428f2b02d86170b5fad455/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:45,153 INFO [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:45,156 DEBUG [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/u 2023-07-22 20:17:45,156 DEBUG [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/u 2023-07-22 20:17:45,157 INFO [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aee51ac7fd428f2b02d86170b5fad455 columnFamilyName u 2023-07-22 20:17:45,158 INFO [StoreOpener-aee51ac7fd428f2b02d86170b5fad455-1] regionserver.HStore(310): Store=aee51ac7fd428f2b02d86170b5fad455/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:45,160 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:45,161 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:45,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-22 20:17:45,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:17:45,190 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 20:17:45,192 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aee51ac7fd428f2b02d86170b5fad455; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9678195840, jitterRate=-0.09864777326583862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-22 20:17:45,192 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aee51ac7fd428f2b02d86170b5fad455: 2023-07-22 20:17:45,194 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455., pid=12, masterSystemTime=1690057065139 2023-07-22 20:17:45,197 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:17:45,197 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:17:45,199 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aee51ac7fd428f2b02d86170b5fad455, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:45,199 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1690057065198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690057065198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690057065198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690057065198"}]},"ts":"1690057065198"} 2023-07-22 20:17:45,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-07-22 20:17:45,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure aee51ac7fd428f2b02d86170b5fad455, server=jenkins-hbase4.apache.org,42833,1690057061382 in 216 msec 2023-07-22 20:17:45,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=9 2023-07-22 20:17:45,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=aee51ac7fd428f2b02d86170b5fad455, ASSIGN in 400 msec 2023-07-22 20:17:45,214 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 20:17:45,215 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057065215"}]},"ts":"1690057065215"} 2023-07-22 20:17:45,219 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2023-07-22 20:17:45,223 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:45,223 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing e39f88ae0f2b248ee9cc38d588346818, disabling compactions & flushes 2023-07-22 20:17:45,223 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:17:45,223 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:17:45,223 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. after waiting 0 ms 2023-07-22 20:17:45,223 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:17:45,223 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:17:45,223 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for e39f88ae0f2b248ee9cc38d588346818: 2023-07-22 20:17:45,224 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 20:17:45,224 WARN [PEWorker-4] access.AccessController(784): Not adding owner permission for table hbase:quota. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-22 20:17:45,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 20:17:45,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 559 msec 2023-07-22 20:17:45,229 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690057065229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690057065229"}]},"ts":"1690057065229"} 2023-07-22 20:17:45,232 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 20:17:45,233 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 20:17:45,234 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057065234"}]},"ts":"1690057065234"} 2023-07-22 20:17:45,236 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-22 20:17:45,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e39f88ae0f2b248ee9cc38d588346818, ASSIGN}] 2023-07-22 20:17:45,244 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e39f88ae0f2b248ee9cc38d588346818, ASSIGN 2023-07-22 20:17:45,245 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=e39f88ae0f2b248ee9cc38d588346818, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42833,1690057061382; forceNewPlan=false, retain=false 2023-07-22 20:17:45,397 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e39f88ae0f2b248ee9cc38d588346818, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:45,397 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690057065396"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690057065396"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690057065396"}]},"ts":"1690057065396"} 2023-07-22 20:17:45,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure e39f88ae0f2b248ee9cc38d588346818, server=jenkins-hbase4.apache.org,42833,1690057061382}] 2023-07-22 20:17:45,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-22 20:17:45,647 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:17:45,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e39f88ae0f2b248ee9cc38d588346818, NAME => 'hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.', STARTKEY => '', ENDKEY => ''} 2023-07-22 20:17:45,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. service=AccessControlService 2023-07-22 20:17:45,648 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 20:17:45,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. service=VisibilityLabelsService 2023-07-22 20:17:45,648 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-22 20:17:45,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:45,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:45,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:45,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:45,651 INFO [StoreOpener-e39f88ae0f2b248ee9cc38d588346818-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:45,653 DEBUG [StoreOpener-e39f88ae0f2b248ee9cc38d588346818-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818/l 2023-07-22 20:17:45,653 DEBUG [StoreOpener-e39f88ae0f2b248ee9cc38d588346818-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818/l 2023-07-22 20:17:45,654 INFO [StoreOpener-e39f88ae0f2b248ee9cc38d588346818-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e39f88ae0f2b248ee9cc38d588346818 columnFamilyName l 2023-07-22 20:17:45,655 INFO [StoreOpener-e39f88ae0f2b248ee9cc38d588346818-1] regionserver.HStore(310): Store=e39f88ae0f2b248ee9cc38d588346818/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:45,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:45,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:45,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:17:45,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 20:17:45,668 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e39f88ae0f2b248ee9cc38d588346818; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10887269280, jitterRate=0.013955965638160706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 20:17:45,668 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e39f88ae0f2b248ee9cc38d588346818: 2023-07-22 20:17:45,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818., pid=14, masterSystemTime=1690057065640 2023-07-22 20:17:45,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:17:45,673 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:17:45,674 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e39f88ae0f2b248ee9cc38d588346818, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:45,674 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690057065674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690057065674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690057065674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690057065674"}]},"ts":"1690057065674"} 2023-07-22 20:17:45,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-22 20:17:45,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure e39f88ae0f2b248ee9cc38d588346818, server=jenkins-hbase4.apache.org,42833,1690057061382 in 276 msec 2023-07-22 20:17:45,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-07-22 20:17:45,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=e39f88ae0f2b248ee9cc38d588346818, ASSIGN in 438 msec 2023-07-22 20:17:45,686 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 20:17:45,686 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057065686"}]},"ts":"1690057065686"} 2023-07-22 20:17:45,689 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-22 20:17:45,692 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 20:17:45,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=hbase:acl in 954 msec 2023-07-22 20:17:46,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-22 20:17:46,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 10 completed 2023-07-22 20:17:46,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 20:17:46,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:labels 2023-07-22 20:17:46,398 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 20:17:46,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "labels" procId is: 15 2023-07-22 20:17:46,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-22 20:17:46,399 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 20:17:46,402 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:46,403 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17 empty. 2023-07-22 20:17:46,404 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:46,404 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:labels regions 2023-07-22 20:17:46,421 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/hbase/labels/.tabledesc/.tableinfo.0000000001 2023-07-22 20:17:46,423 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4ae04ac8306f59f0897e9d44ba3be17, NAME => 'hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp 2023-07-22 20:17:46,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-22 20:17:46,837 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(866): Instantiated hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:46,839 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1604): Closing e4ae04ac8306f59f0897e9d44ba3be17, disabling compactions & flushes 2023-07-22 20:17:46,839 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1626): Closing region hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:17:46,839 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:17:46,839 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. after waiting 0 ms 2023-07-22 20:17:46,839 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:17:46,839 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1838): Closed hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:17:46,839 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1558): Region close journal for e4ae04ac8306f59f0897e9d44ba3be17: 2023-07-22 20:17:46,845 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 20:17:46,847 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1690057066846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690057066846"}]},"ts":"1690057066846"} 2023-07-22 20:17:46,849 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 20:17:46,851 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 20:17:46,851 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057066851"}]},"ts":"1690057066851"} 2023-07-22 20:17:46,853 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLING in hbase:meta 2023-07-22 20:17:46,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=e4ae04ac8306f59f0897e9d44ba3be17, ASSIGN}] 2023-07-22 20:17:46,859 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=e4ae04ac8306f59f0897e9d44ba3be17, ASSIGN 2023-07-22 20:17:46,861 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:labels, region=e4ae04ac8306f59f0897e9d44ba3be17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42833,1690057061382; forceNewPlan=false, retain=false 2023-07-22 20:17:47,012 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e4ae04ac8306f59f0897e9d44ba3be17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:47,012 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1690057067012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690057067012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690057067012"}]},"ts":"1690057067012"} 2023-07-22 20:17:47,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure e4ae04ac8306f59f0897e9d44ba3be17, server=jenkins-hbase4.apache.org,42833,1690057061382}] 2023-07-22 20:17:47,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-22 20:17:47,175 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:17:47,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4ae04ac8306f59f0897e9d44ba3be17, NAME => 'hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17.', STARTKEY => '', ENDKEY => ''} 2023-07-22 20:17:47,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. service=AccessControlService 2023-07-22 20:17:47,176 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 20:17:47,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. service=VisibilityLabelsService 2023-07-22 20:17:47,177 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-22 20:17:47,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table labels e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:47,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:47,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:47,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:47,180 INFO [StoreOpener-e4ae04ac8306f59f0897e9d44ba3be17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:47,182 DEBUG [StoreOpener-e4ae04ac8306f59f0897e9d44ba3be17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17/f 2023-07-22 20:17:47,182 DEBUG [StoreOpener-e4ae04ac8306f59f0897e9d44ba3be17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17/f 2023-07-22 20:17:47,183 INFO [StoreOpener-e4ae04ac8306f59f0897e9d44ba3be17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4ae04ac8306f59f0897e9d44ba3be17 columnFamilyName f 2023-07-22 20:17:47,184 INFO [StoreOpener-e4ae04ac8306f59f0897e9d44ba3be17-1] regionserver.HStore(310): Store=e4ae04ac8306f59f0897e9d44ba3be17/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:47,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:47,187 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:47,194 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:17:47,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 20:17:47,200 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4ae04ac8306f59f0897e9d44ba3be17; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@49010756, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 20:17:47,214 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2023-07-22 20:17:47,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4ae04ac8306f59f0897e9d44ba3be17: 2023-07-22 20:17:47,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17., pid=17, masterSystemTime=1690057067169 2023-07-22 20:17:47,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:17:47,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(686): ZK sync() operation took 4ms 2023-07-22 20:17:47,219 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:17:47,220 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e4ae04ac8306f59f0897e9d44ba3be17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:47,221 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1690057067220"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690057067220"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690057067220"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690057067220"}]},"ts":"1690057067220"} 2023-07-22 20:17:47,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-22 20:17:47,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure e4ae04ac8306f59f0897e9d44ba3be17, server=jenkins-hbase4.apache.org,42833,1690057061382 in 208 msec 2023-07-22 20:17:47,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-22 20:17:47,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=hbase:labels, region=e4ae04ac8306f59f0897e9d44ba3be17, ASSIGN in 370 msec 2023-07-22 20:17:47,232 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 20:17:47,232 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057067232"}]},"ts":"1690057067232"} 2023-07-22 20:17:47,234 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLED in hbase:meta 2023-07-22 20:17:47,238 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 20:17:47,245 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey hbase:labels jenkins.hfs.0: RWXCA 2023-07-22 20:17:47,268 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42833] access.PermissionStorage(611): Read acl: entry[hbase:labels], kv [jenkins.hfs.0: RWXCA] 2023-07-22 20:17:47,311 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 20:17:47,311 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 20:17:47,311 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:17:47,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-22 20:17:47,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-22 20:17:47,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; CreateTableProcedure table=hbase:labels in 923 msec 2023-07-22 20:17:47,782 INFO [Listener at localhost/40721] hbase.ResourceChecker(147): before: client.TestQuotasShell#testRunShellTests Thread=237, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=144, ProcessCount=173, AvailableMemoryMB=8628 2023-07-22 20:17:47,784 INFO [Listener at localhost/40721] client.AbstractTestShell(93): Starting ruby tests. includes: quotas_test.rb excludes: 2023-07-22 20:17:47,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-22 20:17:47,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:labels, procId: 15 completed 2023-07-22 20:17:47,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds Ruby description: jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 25.362-b09 on 1.8.0_362-b09 +jit [linux-x86_64] uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag 2023-07-22 20:17:49,237 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-22 20:17:49,335 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-22 20:17:49,336 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-22 20:17:49,337 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:labels' 2023-07-22 20:17:49,337 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-22 20:17:49,338 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2023-07-22 20:17:49,684 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:17:49,685 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-22 20:17:49,685 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:17:49,685 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase RegionObservers 2023-07-22 20:17:49,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:17:49,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-22 20:17:49,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:17:49,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-22 20:17:49,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 20:17:49,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-22 20:17:49,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-22 20:17:49,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2023-07-22 20:17:49,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 20:17:49,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-22 20:17:49,687 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:17:49,687 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase MasterObservers Running tests... Skip commands_test.rb because of not included Skip formatter_test.rb because of not included Skip converter_test.rb because of not included Skip list_locks_test.rb because of not included Skip list_procedures_test.rb because of not included Skip rsgroup_shell_test.rb because of not included Skip noninteractive_test.rb because of not included Skip shell_test.rb because of not included Skip table_test.rb because of not included Skip admin2_test.rb because of not included Skip hbase_test.rb because of not included Skip taskmonitor_test.rb because of not included Skip admin_test.rb because of not included Skip replication_admin_test.rb because of not included loading test file 'quotas_test.rb'. Skip security_admin_test.rb because of not included Skip visibility_labels_admin_test.rb because of not included Loaded suite src/test/ruby/tests_runner Started 2023-07-22 20:17:50,671 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x3594e3f6 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:50,692 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34cb3dee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:50,726 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:50,732 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:50,748 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:17:50,755 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-22 20:17:50,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 20:17:50,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase_shell_quota_tests_table 2023-07-22 20:17:50,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 20:17:50,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "hbase_shell_quota_tests_table" procId is: 18 2023-07-22 20:17:50,771 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 20:17:50,776 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:50,777 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0 empty. 2023-07-22 20:17:50,779 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:50,779 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase_shell_quota_tests_table regions 2023-07-22 20:17:50,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-22 20:17:50,812 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp/data/default/hbase_shell_quota_tests_table/.tabledesc/.tableinfo.0000000001 2023-07-22 20:17:50,819 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f3b9459e05cae33b131c77d94b01dd0, NAME => 'hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.tmp 2023-07-22 20:17:50,839 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:50,839 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1604): Closing 0f3b9459e05cae33b131c77d94b01dd0, disabling compactions & flushes 2023-07-22 20:17:50,840 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:50,840 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:50,840 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. after waiting 0 ms 2023-07-22 20:17:50,840 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:50,840 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:50,840 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1558): Region close journal for 0f3b9459e05cae33b131c77d94b01dd0: 2023-07-22 20:17:50,849 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 20:17:50,851 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690057070851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690057070851"}]},"ts":"1690057070851"} 2023-07-22 20:17:50,854 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 20:17:50,855 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 20:17:50,856 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057070855"}]},"ts":"1690057070855"} 2023-07-22 20:17:50,858 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLING in hbase:meta 2023-07-22 20:17:50,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=0f3b9459e05cae33b131c77d94b01dd0, ASSIGN}] 2023-07-22 20:17:50,864 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=0f3b9459e05cae33b131c77d94b01dd0, ASSIGN 2023-07-22 20:17:50,865 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=0f3b9459e05cae33b131c77d94b01dd0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42833,1690057061382; forceNewPlan=false, retain=false 2023-07-22 20:17:51,016 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0f3b9459e05cae33b131c77d94b01dd0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:51,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690057071016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690057071016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690057071016"}]},"ts":"1690057071016"} 2023-07-22 20:17:51,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 0f3b9459e05cae33b131c77d94b01dd0, server=jenkins-hbase4.apache.org,42833,1690057061382}] 2023-07-22 20:17:51,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-22 20:17:51,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:51,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f3b9459e05cae33b131c77d94b01dd0, NAME => 'hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.', STARTKEY => '', ENDKEY => ''} 2023-07-22 20:17:51,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. service=AccessControlService 2023-07-22 20:17:51,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 20:17:51,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. service=VisibilityLabelsService 2023-07-22 20:17:51,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-22 20:17:51,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table hbase_shell_quota_tests_table 0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:51,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 20:17:51,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:51,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:51,191 INFO [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family x of region 0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:51,195 DEBUG [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x 2023-07-22 20:17:51,195 DEBUG [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x 2023-07-22 20:17:51,195 INFO [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f3b9459e05cae33b131c77d94b01dd0 columnFamilyName x 2023-07-22 20:17:51,196 INFO [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] regionserver.HStore(310): Store=0f3b9459e05cae33b131c77d94b01dd0/x, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:51,196 INFO [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family y of region 0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:51,202 DEBUG [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/y 2023-07-22 20:17:51,202 DEBUG [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/y 2023-07-22 20:17:51,203 INFO [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f3b9459e05cae33b131c77d94b01dd0 columnFamilyName y 2023-07-22 20:17:51,204 INFO [StoreOpener-0f3b9459e05cae33b131c77d94b01dd0-1] regionserver.HStore(310): Store=0f3b9459e05cae33b131c77d94b01dd0/y, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 20:17:51,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:51,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:51,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase_shell_quota_tests_table descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-22 20:17:51,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:17:51,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 20:17:51,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f3b9459e05cae33b131c77d94b01dd0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10188305280, jitterRate=-0.05114012956619263}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-22 20:17:51,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f3b9459e05cae33b131c77d94b01dd0: 2023-07-22 20:17:51,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0., pid=20, masterSystemTime=1690057071173 2023-07-22 20:17:51,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:51,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:51,245 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0f3b9459e05cae33b131c77d94b01dd0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:51,245 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690057071244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690057071244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690057071244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690057071244"}]},"ts":"1690057071244"} 2023-07-22 20:17:51,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-22 20:17:51,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 0f3b9459e05cae33b131c77d94b01dd0, server=jenkins-hbase4.apache.org,42833,1690057061382 in 228 msec 2023-07-22 20:17:51,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=18 2023-07-22 20:17:51,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=0f3b9459e05cae33b131c77d94b01dd0, ASSIGN in 389 msec 2023-07-22 20:17:51,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 20:17:51,257 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690057071257"}]},"ts":"1690057071257"} 2023-07-22 20:17:51,260 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLED in hbase:meta 2023-07-22 20:17:51,264 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 20:17:51,265 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey hbase_shell_quota_tests_table jenkins: RWXCA 2023-07-22 20:17:51,268 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42833] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-22 20:17:51,270 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 20:17:51,270 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 20:17:51,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-22 20:17:51,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-22 20:17:51,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-22 20:17:51,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-22 20:17:51,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; CreateTableProcedure table=hbase_shell_quota_tests_table in 509 msec 2023-07-22 20:17:51,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-22 20:17:51,534 INFO [Listener at localhost/40721] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:hbase_shell_quota_tests_table, procId: 18 completed Created table hbase_shell_quota_tests_table Took 0.8004 seconds Took 0.0495 seconds 2023-07-22 20:17:51,650 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x579180b8 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:51,657 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46fb2277, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:51,662 DEBUG [hconnection-0x5aa87ce9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:51,668 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:51,687 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x579180b8 to 127.0.0.1:61246 2023-07-22 20:17:51,687 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0075 seconds 2023-07-22 20:17:51,702 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x4ecf0462 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:51,710 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a199eb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:51,721 DEBUG [hconnection-0x632710ab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:51,724 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:51,732 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ecf0462 to 127.0.0.1:61246 2023-07-22 20:17:51,732 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0091 seconds 2023-07-22 20:17:51,744 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x32bccd57 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:51,753 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52a5912c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:51,756 DEBUG [hconnection-0x6f06f6ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:51,759 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:51,767 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32bccd57 to 127.0.0.1:61246 2023-07-22 20:17:51,768 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:51,776 INFO [Listener at localhost/40721] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:17:51,776 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3594e3f6 to 127.0.0.1:61246 2023-07-22 20:17:51,777 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:17:51,780 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x42ae2a07 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:51,788 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ed416e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:51,793 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:51,797 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:51,816 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:17:51,822 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0292 seconds 2023-07-22 20:17:51,835 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x6cc56355 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:51,874 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@559e9352, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:51,878 DEBUG [hconnection-0x3d01f544-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:51,880 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:51,887 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cc56355 to 127.0.0.1:61246 2023-07-22 20:17:51,887 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0078 seconds 2023-07-22 20:17:51,898 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x2a8b5ec6 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:51,921 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@367d264e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:51,992 DEBUG [hconnection-0x53801a96-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:51,996 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,003 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a8b5ec6 to 127.0.0.1:61246 2023-07-22 20:17:52,003 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:52,006 INFO [Listener at localhost/40721] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:17:52,007 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42ae2a07 to 127.0.0.1:61246 2023-07-22 20:17:52,007 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:17:52,009 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x4b0ab65a to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,017 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65bc9a73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,020 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,023 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,031 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:17:52,037 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0161 seconds 2023-07-22 20:17:52,046 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x73ff5ac8 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,074 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dd99a8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,079 DEBUG [hconnection-0x6cb7fa41-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,086 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,098 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73ff5ac8 to 127.0.0.1:61246 2023-07-22 20:17:52,098 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0068 seconds 2023-07-22 20:17:52,109 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x20fa4ebb to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,126 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@250194a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,135 DEBUG [hconnection-0x67b4a3c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,140 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,151 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20fa4ebb to 127.0.0.1:61246 2023-07-22 20:17:52,151 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0065 seconds 2023-07-22 20:17:52,162 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x42f16bb5 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,184 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425f393f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,262 DEBUG [hconnection-0x2fa72fe8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,266 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,272 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f16bb5 to 127.0.0.1:61246 2023-07-22 20:17:52,272 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:52,273 INFO [Listener at localhost/40721] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:17:52,274 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b0ab65a to 127.0.0.1:61246 2023-07-22 20:17:52,274 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:17:52,276 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x34a58317 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,285 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@204265c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,479 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,483 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,496 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:17:52,499 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0102 seconds 2023-07-22 20:17:52,508 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x48389535 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,521 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c3c6ca5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,527 DEBUG [hconnection-0x7fffb0f1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,534 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,545 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48389535 to 127.0.0.1:61246 2023-07-22 20:17:52,546 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0077 seconds 2023-07-22 20:17:52,559 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x1e0b79b4 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,567 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20a0bbf2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,652 DEBUG [hconnection-0x622e201e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,656 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,664 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e0b79b4 to 127.0.0.1:61246 2023-07-22 20:17:52,665 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:52,666 INFO [Listener at localhost/40721] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:17:52,667 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34a58317 to 127.0.0.1:61246 2023-07-22 20:17:52,667 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:17:52,672 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x75a8ac8f to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,694 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b6759ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,698 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,700 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,706 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:17:52,708 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0095 seconds 2023-07-22 20:17:52,720 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x678f3829 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,731 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57f32c83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,738 DEBUG [hconnection-0x66eb96be-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,752 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,760 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x678f3829 to 127.0.0.1:61246 2023-07-22 20:17:52,760 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0066 seconds 2023-07-22 20:17:52,774 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x27e52f9d to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,780 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56cbd2ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,782 DEBUG [hconnection-0x3c5e912d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,790 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27e52f9d to 127.0.0.1:61246 2023-07-22 20:17:52,790 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:52,792 INFO [Listener at localhost/40721] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:17:52,792 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75a8ac8f to 127.0.0.1:61246 2023-07-22 20:17:52,793 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:17:52,794 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x212e96c2 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:52,803 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29a3619e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:52,899 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:52,901 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:52,907 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:17:52,910 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0091 seconds 2023-07-22 20:17:52,935 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:17:52,938 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService Took 0.0216 seconds Took 0.0099 seconds Took 0.0027 seconds Took 0.0040 seconds Took 0.0025 seconds Took 0.0026 seconds Took 0.0040 seconds Took 0.0024 seconds Took 0.0034 seconds Took 0.0021 seconds 2023-07-22 20:17:53,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-22 20:17:53,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-22 20:17:53,011 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-22 20:17:53,011 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-22 20:17:53,011 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-22 20:17:53,012 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-22 20:17:53,012 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,012 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:53,014 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-22 20:17:53,014 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-22 20:17:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 20:17:53,014 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,015 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 20:17:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:53,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-22 20:17:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:53,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-22 20:17:53,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-22 20:17:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-22 20:17:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-22 20:17:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-22 20:17:53,022 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-22 20:17:53,022 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-22 20:17:53,022 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:53,022 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. started... 2023-07-22 20:17:53,024 INFO [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0f3b9459e05cae33b131c77d94b01dd0 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-22 20:17:53,107 INFO [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=14 (bloomFilter=true), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/.tmp/x/c6591be86d184515947c41fa18d1e058 2023-07-22 20:17:53,158 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/.tmp/x/c6591be86d184515947c41fa18d1e058 as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/c6591be86d184515947c41fa18d1e058 2023-07-22 20:17:53,168 INFO [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/c6591be86d184515947c41fa18d1e058, entries=10, sequenceid=14, filesize=5.0 K 2023-07-22 20:17:53,172 INFO [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for 0f3b9459e05cae33b131c77d94b01dd0 in 148ms, sequenceid=14, compaction requested=false 2023-07-22 20:17:53,172 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase_shell_quota_tests_table' 2023-07-22 20:17:53,174 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0f3b9459e05cae33b131c77d94b01dd0: 2023-07-22 20:17:53,174 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:53,174 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-22 20:17:53,175 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-22 20:17:53,175 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,175 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-22 20:17:53,175 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42833,1690057061382' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-22 20:17:53,178 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,178 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:53,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:53,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-22 20:17:53,179 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:53,179 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 20:17:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:53,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:53,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:53,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42833,1690057061382' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-22 20:17:53,181 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-22 20:17:53,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@343fa1bc[Count = 0] remaining members to acquire global barrier 2023-07-22 20:17:53,181 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:53,183 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:53,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:53,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:53,183 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-22 20:17:53,184 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-22 20:17:53,184 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,42833,1690057061382' in zk 2023-07-22 20:17:53,184 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,184 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 20:17:53,187 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,187 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-22 20:17:53,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:53,187 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 20:17:53,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-22 20:17:53,187 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-22 20:17:53,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:53,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:53,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:53,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,42833,1690057061382': 2023-07-22 20:17:53,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42833,1690057061382' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-22 20:17:53,191 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-22 20:17:53,191 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 20:17:53,191 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 20:17:53,191 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-22 20:17:53,192 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-22 20:17:53,194 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,194 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:53,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-22 20:17:53,194 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-22 20:17:53,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:53,195 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-22 20:17:53,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 20:17:53,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:53,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,197 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:53,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:53,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,204 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-22 20:17:53,204 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-22 20:17:53,205 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-22 20:17:53,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 20:17:53,205 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 20:17:53,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-22 20:17:53,205 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:53,205 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:53,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-22 20:17:53,205 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,206 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:53,206 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:53,206 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:53,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-22 20:17:53,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 20:17:53,208 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-22 20:17:53,209 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-22 20:17:53,460 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-22 20:17:53,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.4890 seconds 2023-07-22 20:17:53,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-22 20:17:53,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690057073484 (current time:1690057073484). 2023-07-22 20:17:53,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 20:17:53,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ReadOnlyZKClient(139): Connect 0x60906824 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:53,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a2aeafd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:53,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:53,495 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:53,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60906824 to 127.0.0.1:61246 2023-07-22 20:17:53,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:53,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ReadOnlyZKClient(139): Connect 0x73e8bca2 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:53,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f201e46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:53,503 DEBUG [hconnection-0x77f38b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:53,505 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:53,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73e8bca2 to 127.0.0.1:61246 2023-07-22 20:17:53,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:53,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-22 20:17:53,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 20:17:53,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-22 20:17:53,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-22 20:17:53,552 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-22 20:17:53,553 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=21, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1690057673553 2023-07-22 20:17:53,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-22 20:17:53,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-22 20:17:53,555 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=21, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-22 20:17:53,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-22 20:17:53,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 11 msec 2023-07-22 20:17:53,557 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-22 20:17:53,558 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1690057673558 2023-07-22 20:17:53,560 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-22 20:17:53,560 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-22 20:17:53,812 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 20:17:53,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-22 20:17:53,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-22 20:17:53,819 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 20:17:53,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,976 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_1' 2023-07-22 20:17:53,976 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 20:17:53,976 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_1' starting 'acquire' 2023-07-22 20:17:53,976 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_1', kicking off acquire phase on members. 2023-07-22 20:17:53,977 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,977 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,979 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 20:17:53,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 20:17:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 20:17:53,980 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,980 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,981 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 20:17:53,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-22 20:17:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,982 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_1 from table hbase_shell_quota_tests_table type FLUSH 2023-07-22 20:17:53,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,990 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_1' with timeout 300000ms 2023-07-22 20:17:53,991 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 20:17:53,991 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_1' starting 'acquire' stage 2023-07-22 20:17:53,991 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_1' locally acquired 2023-07-22 20:17:53,991 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42833,1690057061382' joining acquired barrier for procedure (hbase_shell_quota_tests_table_1) in zk 2023-07-22 20:17:53,994 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,994 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 20:17:53,995 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,995 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 20:17:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:53,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:53,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:53,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42833,1690057061382' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_1' on coordinator 2023-07-22 20:17:53,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60fc1e8d[Count = 0] remaining members to acquire global barrier 2023-07-22 20:17:53,997 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_1' starting 'in-barrier' execution. 2023-07-22 20:17:53,998 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,999 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-22 20:17:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,000 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,000 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 20:17:54,001 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_1' received 'reached' from coordinator. 2023-07-22 20:17:54,002 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 20:17:54,002 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 20:17:54,002 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:54,003 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. started... 2023-07-22 20:17:54,003 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f3b9459e05cae33b131c77d94b01dd0: 2023-07-22 20:17:54,004 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.' region-info for snapshot=hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,010 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 20:17:54,014 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/c6591be86d184515947c41fa18d1e058] hfiles 2023-07-22 20:17:54,014 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/c6591be86d184515947c41fa18d1e058 for snapshot=hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,017 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 20:17:54,320 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 20:17:54,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-22 20:17:54,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-22 20:17:54,323 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-22 20:17:54,439 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. completed. 2023-07-22 20:17:54,439 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 20:17:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 20:17:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_1' locally completed 2023-07-22 20:17:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_1' completed for member 'jenkins-hbase4.apache.org,42833,1690057061382' in zk 2023-07-22 20:17:54,443 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,443 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_1' has notified controller of completion 2023-07-22 20:17:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 20:17:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 20:17:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_1' completed. 2023-07-22 20:17:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_1' member 'jenkins-hbase4.apache.org,42833,1690057061382': 2023-07-22 20:17:54,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42833,1690057061382' released barrier for procedure'hbase_shell_quota_tests_table_1', counting down latch. Waiting for 0 more 2023-07-22 20:17:54,448 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_1' execution completed 2023-07-22 20:17:54,448 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 20:17:54,448 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 20:17:54,448 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,448 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 20:17:54,451 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,451 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 20:17:54,451 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 20:17:54,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 20:17:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 20:17:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:54,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,453 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:54,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,455 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:54,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,464 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,465 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,465 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,465 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:54,465 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,465 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,465 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,466 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 20:17:54,466 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 20:17:54,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 20:17:54,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 20:17:54,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,466 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 20:17:54,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 20:17:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 20:17:54,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-22 20:17:54,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 to hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/hbase_shell_quota_tests_table_1 2023-07-22 20:17:55,074 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 20:17:55,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-22 20:17:55,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-22 20:17:55,076 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2428): (#4) Sleeping: 1250ms while waiting for snapshot completion. 2023-07-22 20:17:55,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed 2023-07-22 20:17:55,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-22 20:17:55,345 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-22 20:17:55,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1690057073554Consolidate snapshot: hbase_shell_quota_tests_table_1 at 1690057074467 (+913 ms)Loading Region manifests for hbase_shell_quota_tests_table_1 at 1690057074468 (+1 ms)Writing data manifest for hbase_shell_quota_tests_table_1 at 1690057074481 (+13 ms)Verifying snapshot: hbase_shell_quota_tests_table_1 at 1690057074905 (+424 ms)Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed at 1690057075344 (+439 ms) 2023-07-22 20:17:55,346 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-22 20:17:55,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 1.7910 sec 2023-07-22 20:17:56,327 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 20:17:56,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-22 20:17:56,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 2.8605 seconds Took 0.0024 seconds Took 0.0023 seconds Took 0.0016 seconds Took 0.0016 seconds Took 0.0016 seconds Took 0.0022 seconds Took 0.0015 seconds Took 0.0015 seconds Took 0.0015 seconds Took 0.0015 seconds 2023-07-22 20:17:56,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-22 20:17:56,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] procedure.ProcedureCoordinator(143): Procedure hbase_shell_quota_tests_table was in running list but was completed. Accepting new attempt. 2023-07-22 20:17:56,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-22 20:17:56,366 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-22 20:17:56,366 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-22 20:17:56,366 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-22 20:17:56,367 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-22 20:17:56,367 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,367 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:56,369 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-22 20:17:56,369 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-22 20:17:56,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 20:17:56,370 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,370 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 20:17:56,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:56,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-22 20:17:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:56,371 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-22 20:17:56,371 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc hbase_shell_quota_tests_table is still present, removing 2023-07-22 20:17:56,371 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-22 20:17:56,371 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-22 20:17:56,371 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-22 20:17:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-22 20:17:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-22 20:17:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-22 20:17:56,372 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:56,372 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. started... 2023-07-22 20:17:56,372 INFO [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0f3b9459e05cae33b131c77d94b01dd0 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-22 20:17:56,388 INFO [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=28 (bloomFilter=true), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/.tmp/x/2841c0effd4640b9bd92259f2c028de2 2023-07-22 20:17:56,398 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/.tmp/x/2841c0effd4640b9bd92259f2c028de2 as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/2841c0effd4640b9bd92259f2c028de2 2023-07-22 20:17:56,407 INFO [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/2841c0effd4640b9bd92259f2c028de2, entries=10, sequenceid=28, filesize=5.0 K 2023-07-22 20:17:56,409 INFO [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for 0f3b9459e05cae33b131c77d94b01dd0 in 37ms, sequenceid=28, compaction requested=false 2023-07-22 20:17:56,409 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0f3b9459e05cae33b131c77d94b01dd0: 2023-07-22 20:17:56,409 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:56,409 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-22 20:17:56,410 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-22 20:17:56,410 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,410 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-22 20:17:56,410 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42833,1690057061382' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-22 20:17:56,412 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,412 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-22 20:17:56,412 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:56,412 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 20:17:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:56,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42833,1690057061382' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-22 20:17:56,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@219198a4[Count = 0] remaining members to acquire global barrier 2023-07-22 20:17:56,414 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-22 20:17:56,414 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:56,415 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:56,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:56,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:56,415 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-22 20:17:56,415 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-22 20:17:56,416 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,42833,1690057061382' in zk 2023-07-22 20:17:56,416 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,416 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 20:17:56,417 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,417 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-22 20:17:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-22 20:17:56,417 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 20:17:56,417 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-22 20:17:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:56,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:56,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,42833,1690057061382': 2023-07-22 20:17:56,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42833,1690057061382' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-22 20:17:56,421 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-22 20:17:56,421 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 20:17:56,421 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 20:17:56,421 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-22 20:17:56,421 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-22 20:17:56,424 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,424 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-22 20:17:56,424 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-22 20:17:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:56,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-22 20:17:56,425 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 20:17:56,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:56,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:56,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:56,426 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:56,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-22 20:17:56,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,429 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,429 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-22 20:17:56,429 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:56,429 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 20:17:56,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table because node does not exist (not an error) 2023-07-22 20:17:56,429 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-22 20:17:56,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-22 20:17:56,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-22 20:17:56,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-22 20:17:56,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 20:17:56,429 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-22 20:17:56,430 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,430 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:56,430 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-22 20:17:56,430 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-22 20:17:56,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-22 20:17:56,430 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-22 20:17:56,431 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-22 20:17:56,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 20:17:56,681 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-22 20:17:56,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.3251 seconds 2023-07-22 20:17:56,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-22 20:17:56,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690057076685 (current time:1690057076685). 2023-07-22 20:17:56,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 20:17:56,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ReadOnlyZKClient(139): Connect 0x7ed32b48 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:56,689 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-22 20:17:56,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4452f884, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:56,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:56,695 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:56,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ed32b48 to 127.0.0.1:61246 2023-07-22 20:17:56,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:56,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ReadOnlyZKClient(139): Connect 0x5be143d9 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:17:56,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c8fba86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:17:56,705 DEBUG [hconnection-0x6f4af34b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:17:56,706 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:17:56,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5be143d9 to 127.0.0.1:61246 2023-07-22 20:17:56,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:17:56,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-22 20:17:56,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 20:17:56,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-22 20:17:56,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-22 20:17:56,717 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-22 20:17:56,718 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=23, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1690057676718 2023-07-22 20:17:56,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-22 20:17:56,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-22 20:17:56,719 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-22 20:17:56,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-22 20:17:56,720 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=23, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-22 20:17:56,720 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-22 20:17:56,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 5 msec 2023-07-22 20:17:56,722 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-22 20:17:56,723 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=24, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1690057676723 2023-07-22 20:17:56,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,746 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_2' 2023-07-22 20:17:56,746 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 20:17:56,747 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_2' starting 'acquire' 2023-07-22 20:17:56,747 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_2', kicking off acquire phase on members. 2023-07-22 20:17:56,747 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,747 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,748 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,748 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 20:17:56,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 20:17:56,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 20:17:56,749 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,749 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 20:17:56,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-22 20:17:56,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_2 from table hbase_shell_quota_tests_table type FLUSH 2023-07-22 20:17:56,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,751 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_2' with timeout 300000ms 2023-07-22 20:17:56,751 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 20:17:56,751 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_2' starting 'acquire' stage 2023-07-22 20:17:56,751 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_2' locally acquired 2023-07-22 20:17:56,751 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42833,1690057061382' joining acquired barrier for procedure (hbase_shell_quota_tests_table_2) in zk 2023-07-22 20:17:56,752 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,752 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 20:17:56,753 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,753 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 20:17:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:56,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:56,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42833,1690057061382' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_2' on coordinator 2023-07-22 20:17:56,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66e94d2[Count = 0] remaining members to acquire global barrier 2023-07-22 20:17:56,754 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_2' starting 'in-barrier' execution. 2023-07-22 20:17:56,755 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,757 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,757 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_2' received 'reached' from coordinator. 2023-07-22 20:17:56,757 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:56,757 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 20:17:56,758 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 20:17:56,758 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. started... 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f3b9459e05cae33b131c77d94b01dd0: 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0.' region-info for snapshot=hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/c6591be86d184515947c41fa18d1e058, hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/2841c0effd4640b9bd92259f2c028de2] hfiles 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/c6591be86d184515947c41fa18d1e058 for snapshot=hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/x/2841c0effd4640b9bd92259f2c028de2 for snapshot=hbase_shell_quota_tests_table_2 2023-07-22 20:17:56,758 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 20:17:56,971 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 20:17:56,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-22 20:17:56,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-22 20:17:56,974 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 20:17:57,169 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. completed. 2023-07-22 20:17:57,170 DEBUG [rs(jenkins-hbase4.apache.org,42833,1690057061382)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:17:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 20:17:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 20:17:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_2' locally completed 2023-07-22 20:17:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_2' completed for member 'jenkins-hbase4.apache.org,42833,1690057061382' in zk 2023-07-22 20:17:57,172 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,172 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_2' has notified controller of completion 2023-07-22 20:17:57,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:57,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 20:17:57,172 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 20:17:57,172 DEBUG [member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_2' completed. 2023-07-22 20:17:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:57,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_2' member 'jenkins-hbase4.apache.org,42833,1690057061382': 2023-07-22 20:17:57,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42833,1690057061382' released barrier for procedure'hbase_shell_quota_tests_table_2', counting down latch. Waiting for 0 more 2023-07-22 20:17:57,176 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_2' execution completed 2023-07-22 20:17:57,176 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 20:17:57,176 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 20:17:57,176 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,176 INFO [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_2including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 20:17:57,178 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,178 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 20:17:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 20:17:57,179 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 20:17:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 20:17:57,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 20:17:57,179 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 20:17:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 20:17:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,181 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 20:17:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,183 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,183 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 20:17:57,183 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 20:17:57,183 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,183 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 20:17:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 20:17:57,183 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:17:57,184 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,184 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,184 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 because node does not exist (not an error) 2023-07-22 20:17:57,184 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,184 DEBUG [(jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 20:17:57,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 20:17:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 20:17:57,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 to hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/hbase_shell_quota_tests_table_2 2023-07-22 20:17:57,474 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 20:17:57,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-22 20:17:57,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-22 20:17:57,476 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-22 20:17:58,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed 2023-07-22 20:17:58,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-22 20:17:58,034 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-22 20:17:58,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1690057076718Consolidate snapshot: hbase_shell_quota_tests_table_2 at 1690057077184 (+466 ms)Loading Region manifests for hbase_shell_quota_tests_table_2 at 1690057077185 (+1 ms)Writing data manifest for hbase_shell_quota_tests_table_2 at 1690057077189 (+4 ms)Verifying snapshot: hbase_shell_quota_tests_table_2 at 1690057077198 (+9 ms)Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed at 1690057078033 (+835 ms) 2023-07-22 20:17:58,035 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=24, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-22 20:17:58,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 1.3160 sec 2023-07-22 20:17:58,227 DEBUG [Listener at localhost/40721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 20:17:58,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-22 20:17:58,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 1.5461 seconds 2023-07-22 20:20:01,028 DEBUG [master/jenkins-hbase4:0.Chore.1] quotas.QuotaObserverChore(336): hbase_shell_quota_tests_table moved into observance of table space quota. 2023-07-22 20:22:41,399 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache(965): totalSize=587.81 KB, freeSize=781.83 MB, max=782.40 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2023-07-22 20:22:41,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): data stats (chunk size=2097152): current pool size=1, created chunk count=9, reused chunk count=1, reuseRatio=10.00% 2023-07-22 20:22:41,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2023-07-22 20:22:42,976 INFO [jenkins-hbase4:42833Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-22 20:22:43,930 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-22 20:22:43,932 DEBUG [master/jenkins-hbase4:0.Chore.1] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster. 2023-07-22 20:22:43,932 DEBUG [master/jenkins-hbase4:0.Chore.1] master.HMaster(1882): Balancer is going into sleep until next period in 300000ms 2023-07-22 20:22:43,937 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(200): Skipping table hbase_shell_quota_tests_table because normalization is disabled in its table properties and normalization is also disabled at table level by default 2023-07-22 20:22:44,937 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. because 7ece6ce984aff03a55850b79f120f699/info has an old edit so flush to free WALs after random delay 199072 ms 2023-07-22 20:22:44,938 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because 1588230740/info has an old edit so flush to free WALs after random delay 187967 ms 2023-07-22 20:22:47,998 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. because e4ae04ac8306f59f0897e9d44ba3be17/f has an old edit so flush to free WALs after random delay 44426 ms 2023-07-22 20:22:47,999 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. because e39f88ae0f2b248ee9cc38d588346818/l has an old edit so flush to free WALs after random delay 295557 ms 2023-07-22 20:22:49,236 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-22 20:22:51,964 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. because aee51ac7fd428f2b02d86170b5fad455/q has an old edit so flush to free WALs after random delay 257459 ms 2023-07-22 20:22:52,952 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:22:52,954 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2023-07-22 20:23:32,426 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing e4ae04ac8306f59f0897e9d44ba3be17 1/1 column families, dataSize=32 B heapSize=360 B 2023-07-22 20:23:32,440 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32 B at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17/.tmp/f/d74ba52dd5cd4874985a830933d23a21 2023-07-22 20:23:32,448 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17/.tmp/f/d74ba52dd5cd4874985a830933d23a21 as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17/f/d74ba52dd5cd4874985a830933d23a21 2023-07-22 20:23:32,454 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17/f/d74ba52dd5cd4874985a830933d23a21, entries=1, sequenceid=4, filesize=4.6 K 2023-07-22 20:23:32,455 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~32 B/32, heapSize ~344 B/344, currentSize=0 B/0 for e4ae04ac8306f59f0897e9d44ba3be17 in 29ms, sequenceid=4, compaction requested=false 2023-07-22 20:23:32,455 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for e4ae04ac8306f59f0897e9d44ba3be17: 2023-07-22 20:23:46,758 DEBUG [master/jenkins-hbase4:0.Chore.1] zookeeper.ReadOnlyZKClient(139): Connect 0x5c232422 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:46,763 DEBUG [master/jenkins-hbase4:0.Chore.1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22a00079, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:46,765 DEBUG [hconnection-0x6fc78eb9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:46,766 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:23:48,553 INFO [Listener at localhost/40721] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:23:48,553 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x212e96c2 to 127.0.0.1:61246 2023-07-22 20:23:48,554 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,558 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x484d9b39 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,564 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a22a451, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,567 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,569 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:23:48,574 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x484d9b39 to 127.0.0.1:61246 2023-07-22 20:23:48,575 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,580 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x6c42feb1 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,584 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7304a326, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,585 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,587 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:23:48,593 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c42feb1 to 127.0.0.1:61246 2023-07-22 20:23:48,593 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,594 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x495d19a1 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,598 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72c7a4c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,600 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,602 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:23:48,606 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x495d19a1 to 127.0.0.1:61246 2023-07-22 20:23:48,606 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,607 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x6baea5d0 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,619 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c10cfcd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,621 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,623 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0110 seconds Took 0.0010 seconds Took 0.0010 seconds Took 0.0023 seconds Took 0.0011 seconds Took 0.0010 seconds Took 0.0012 seconds Took 0.0011 seconds Took 0.0012 seconds Took 0.0012 seconds Took 0.0012 seconds Took 0.0013 seconds 2023-07-22 20:23:48,670 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6baea5d0 to 127.0.0.1:61246 2023-07-22 20:23:48,670 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,672 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x30152185 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,683 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6627a527, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,685 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,687 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0012 seconds 2023-07-22 20:23:48,694 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30152185 to 127.0.0.1:61246 2023-07-22 20:23:48,694 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,696 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x3a1daa0d to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,703 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ec76338, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,705 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,707 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0008 seconds 2023-07-22 20:23:48,712 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a1daa0d to 127.0.0.1:61246 2023-07-22 20:23:48,712 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,715 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x3ce035bc to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,719 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40e6279a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,721 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,723 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0009 seconds 2023-07-22 20:23:48,727 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ce035bc to 127.0.0.1:61246 2023-07-22 20:23:48,727 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,728 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x737f4ef0 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,734 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40918ee9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,735 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,737 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:23:48,740 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:23:48,742 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0060 seconds 2023-07-22 20:23:48,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from false to true 2023-07-22 20:23:48,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from true to false Took 0.0031 seconds 2023-07-22 20:23:48,765 INFO [Listener at localhost/40721] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:23:48,765 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x737f4ef0 to 127.0.0.1:61246 2023-07-22 20:23:48,766 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:48,767 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x0d5233d6 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:48,772 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a5fa48a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:48,773 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:48,775 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 20:23:48,779 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 20:23:48,782 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-22 20:23:48,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] zookeeper.ZKUtil(398): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-22 20:23:48,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from true to false 2023-07-22 20:23:48,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] procedure2.ProcedureExecutor(1029): Stored pid=25, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,41649,1690057059500, rpcThrottleEnabled=false 2023-07-22 20:23:48,797 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:23:48,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,42833,1690057061382, rpcThrottleEnabled=false}] 2023-07-22 20:23:48,958 DEBUG [RSProcedureDispatcher-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 20:23:48,961 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 20:23:48,961 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42833] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=26 2023-07-22 20:23:48,962 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from true to false 2023-07-22 20:23:48,965 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=26 2023-07-22 20:23:48,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41649] master.HMaster(3641): Remote procedure done, pid=26 2023-07-22 20:23:48,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=25 2023-07-22 20:23:48,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=25, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,42833,1690057061382, rpcThrottleEnabled=false in 170 msec 2023-07-22 20:23:48,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,41649,1690057059500, rpcThrottleEnabled=false in 185 msec 2023-07-22 20:23:48,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from false to true 2023-07-22 20:23:48,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41649] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,41649,1690057059500, rpcThrottleEnabled=true 2023-07-22 20:23:48,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,42833,1690057061382, rpcThrottleEnabled=true}] 2023-07-22 20:23:49,134 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42833] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=28 2023-07-22 20:23:49,134 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from false to true 2023-07-22 20:23:49,134 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=28 2023-07-22 20:23:49,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41649] master.HMaster(3641): Remote procedure done, pid=28 2023-07-22 20:23:49,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-22 20:23:49,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,42833,1690057061382, rpcThrottleEnabled=true in 155 msec 2023-07-22 20:23:49,140 INFO [Listener at localhost/40721] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:23:49,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,41649,1690057059500, rpcThrottleEnabled=true in 163 msec 2023-07-22 20:23:49,141 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d5233d6 to 127.0.0.1:61246 2023-07-22 20:23:49,141 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-22 20:23:49,143 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(139): Connect 0x66dd40a3 to 127.0.0.1:61246 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 20:23:49,148 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6476c515, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-22 20:23:49,151 DEBUG [Listener at localhost/40721] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 20:23:49,153 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0014 seconds 2023-07-22 20:23:49,158 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66dd40a3 to 127.0.0.1:61246 2023-07-22 20:23:49,159 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client . Finished in 358.500253 seconds. ------------------------------------------------------------------------------- 16 tests, 62 assertions, 0 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications 100% passed ------------------------------------------------------------------------------- 0.04 tests/s, 0.17 assertions/s Done with tests! Shutting down the cluster... 2023-07-22 20:23:49,180 INFO [Listener at localhost/40721] hbase.ResourceChecker(175): after: client.TestQuotasShell#testRunShellTests Thread=268 (was 237) Potentially hanging thread: (jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x66dd40a3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x3ce035bc-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c1f032b-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x3a1daa0d-SendThread(127.0.0.1:61246) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x5c232422-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x3ce035bc java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/612535006.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x3a1daa0d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c1f032b-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x3ce035bc-SendThread(127.0.0.1:61246) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-725327859_17 at /127.0.0.1:41180 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Ruby-0-JIT-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x66dd40a3-SendThread(127.0.0.1:61246) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x0d5233d6 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/612535006.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41649,1690057059500)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jnr.ffi.util.ref.internal.Finalizer java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) jnr.ffi.util.ref.internal.Finalizer.run(Finalizer.java:180) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6fc78eb9-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c1f032b-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6c1f032b-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x66dd40a3 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/612535006.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x30152185-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x30152185 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/612535006.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x5c232422 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/612535006.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6fc78eb9-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x0d5233d6-SendThread(127.0.0.1:61246) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RSProcedureDispatcher-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x30152185-SendThread(127.0.0.1:61246) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x5c232422-SendThread(127.0.0.1:61246) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42833,1690057061382' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x0d5233d6-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61246@0x3a1daa0d java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/612535006.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=493 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=5 (was 144), ProcessCount=171 (was 173), AvailableMemoryMB=8982 (was 8628) - AvailableMemoryMB LEAK? - 2023-07-22 20:23:49,182 INFO [Listener at localhost/40721] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-22 20:23:49,182 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fff9076 to 127.0.0.1:61246 2023-07-22 20:23:49,182 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:23:49,182 DEBUG [Listener at localhost/40721] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-22 20:23:49,182 DEBUG [Listener at localhost/40721] util.JVMClusterUtil(257): Found active master hash=38526466, stopped=false 2023-07-22 20:23:49,183 DEBUG [Listener at localhost/40721] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:49,183 DEBUG [Listener at localhost/40721] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 20:23:49,183 DEBUG [Listener at localhost/40721] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:23:49,183 DEBUG [Listener at localhost/40721] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-22 20:23:49,183 INFO [Listener at localhost/40721] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:23:49,186 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 20:23:49,186 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 20:23:49,186 INFO [Listener at localhost/40721] procedure2.ProcedureExecutor(629): Stopping 2023-07-22 20:23:49,186 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:23:49,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 20:23:49,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 20:23:49,187 DEBUG [Listener at localhost/40721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a42da7c to 127.0.0.1:61246 2023-07-22 20:23:49,187 DEBUG [Listener at localhost/40721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:23:49,187 INFO [Listener at localhost/40721] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42833,1690057061382' ***** 2023-07-22 20:23:49,187 DEBUG [Listener at localhost/40721] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:49,187 INFO [Listener at localhost/40721] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 20:23:49,187 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-22 20:23:49,196 INFO [RS:0;jenkins-hbase4:42833] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@7d263fa9{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-22 20:23:49,199 INFO [RS:0;jenkins-hbase4:42833] server.AbstractConnector(383): Stopped ServerConnector@1c0828f9{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-22 20:23:49,200 INFO [RS:0;jenkins-hbase4:42833] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-22 20:23:49,200 INFO [RS:0;jenkins-hbase4:42833] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@6234eb75{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-22 20:23:49,200 INFO [RS:0;jenkins-hbase4:42833] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2ce9c0a0{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/hadoop.log.dir/,STOPPED} 2023-07-22 20:23:49,202 INFO [RS:0;jenkins-hbase4:42833] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 20:23:49,203 INFO [RS:0;jenkins-hbase4:42833] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 20:23:49,203 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 20:23:49,203 INFO [RS:0;jenkins-hbase4:42833] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 20:23:49,203 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(3305): Received CLOSE for 7ece6ce984aff03a55850b79f120f699 2023-07-22 20:23:49,204 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(3305): Received CLOSE for e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:23:49,204 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(3305): Received CLOSE for aee51ac7fd428f2b02d86170b5fad455 2023-07-22 20:23:49,204 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(3305): Received CLOSE for 0f3b9459e05cae33b131c77d94b01dd0 2023-07-22 20:23:49,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ece6ce984aff03a55850b79f120f699, disabling compactions & flushes 2023-07-22 20:23:49,204 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(3305): Received CLOSE for e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:23:49,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:23:49,204 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:23:49,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:23:49,204 INFO [RS:0;jenkins-hbase4:42833] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 20:23:49,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. after waiting 0 ms 2023-07-22 20:23:49,204 DEBUG [RS:0;jenkins-hbase4:42833] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53f6f962 to 127.0.0.1:61246 2023-07-22 20:23:49,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:23:49,205 DEBUG [RS:0;jenkins-hbase4:42833] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:23:49,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7ece6ce984aff03a55850b79f120f699 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-22 20:23:49,205 INFO [RS:0;jenkins-hbase4:42833] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 20:23:49,205 INFO [RS:0;jenkins-hbase4:42833] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 20:23:49,205 INFO [RS:0;jenkins-hbase4:42833] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 20:23:49,205 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-22 20:23:49,205 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1474): Waiting on 6 regions to close 2023-07-22 20:23:49,205 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1478): Online Regions={7ece6ce984aff03a55850b79f120f699=hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699., e4ae04ac8306f59f0897e9d44ba3be17=hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17., 1588230740=hbase:meta,,1.1588230740, aee51ac7fd428f2b02d86170b5fad455=hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455., 0f3b9459e05cae33b131c77d94b01dd0=hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0., e39f88ae0f2b248ee9cc38d588346818=hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.} 2023-07-22 20:23:49,206 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 20:23:49,206 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 20:23:49,206 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 20:23:49,206 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 20:23:49,206 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 20:23:49,206 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=6.34 KB heapSize=11.52 KB 2023-07-22 20:23:49,206 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on 0f3b9459e05cae33b131c77d94b01dd0, 1588230740, 7ece6ce984aff03a55850b79f120f699, aee51ac7fd428f2b02d86170b5fad455, e39f88ae0f2b248ee9cc38d588346818, e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:23:49,259 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 20:23:49,407 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on 0f3b9459e05cae33b131c77d94b01dd0, 1588230740, 7ece6ce984aff03a55850b79f120f699, aee51ac7fd428f2b02d86170b5fad455, e39f88ae0f2b248ee9cc38d588346818, e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:23:49,607 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on 0f3b9459e05cae33b131c77d94b01dd0, 1588230740, 7ece6ce984aff03a55850b79f120f699, aee51ac7fd428f2b02d86170b5fad455, e39f88ae0f2b248ee9cc38d588346818, e4ae04ac8306f59f0897e9d44ba3be17 2023-07-22 20:23:49,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699/.tmp/info/b1626e345f9b42c58f80bdbb1a59159f 2023-07-22 20:23:49,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.88 KB at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/.tmp/info/c27e37056c984e7bbb9e5a857491d2ec 2023-07-22 20:23:49,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699/.tmp/info/b1626e345f9b42c58f80bdbb1a59159f as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699/info/b1626e345f9b42c58f80bdbb1a59159f 2023-07-22 20:23:49,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699/info/b1626e345f9b42c58f80bdbb1a59159f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-22 20:23:49,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7ece6ce984aff03a55850b79f120f699 in 445ms, sequenceid=6, compaction requested=false 2023-07-22 20:23:49,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/namespace/7ece6ce984aff03a55850b79f120f699/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 20:23:49,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:49,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:23:49,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:23:49,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ece6ce984aff03a55850b79f120f699: 2023-07-22 20:23:49,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690057063939.7ece6ce984aff03a55850b79f120f699. 2023-07-22 20:23:49,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4ae04ac8306f59f0897e9d44ba3be17, disabling compactions & flushes 2023-07-22 20:23:49,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:23:49,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:23:49,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. after waiting 0 ms 2023-07-22 20:23:49,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:23:49,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/labels/e4ae04ac8306f59f0897e9d44ba3be17/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=1 2023-07-22 20:23:49,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:49,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:23:49,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:23:49,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4ae04ac8306f59f0897e9d44ba3be17: 2023-07-22 20:23:49,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:labels,,1690057066394.e4ae04ac8306f59f0897e9d44ba3be17. 2023-07-22 20:23:49,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aee51ac7fd428f2b02d86170b5fad455, disabling compactions & flushes 2023-07-22 20:23:49,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:23:49,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:23:49,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. after waiting 0 ms 2023-07-22 20:23:49,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:23:49,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing aee51ac7fd428f2b02d86170b5fad455 2/2 column families, dataSize=1.31 KB heapSize=3.84 KB 2023-07-22 20:23:49,684 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:49,684 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:49,684 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 20:23:49,684 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-22 20:23:49,685 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:23:49,807 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on 0f3b9459e05cae33b131c77d94b01dd0, 1588230740, aee51ac7fd428f2b02d86170b5fad455, e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:23:49,988 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-22 20:23:49,988 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-22 20:23:50,007 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on 0f3b9459e05cae33b131c77d94b01dd0, 1588230740, aee51ac7fd428f2b02d86170b5fad455, e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:23:50,049 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=472 B at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/.tmp/table/3b379ad0e55b4a29b34702ea522a7014 2023-07-22 20:23:50,057 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/.tmp/info/c27e37056c984e7bbb9e5a857491d2ec as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/info/c27e37056c984e7bbb9e5a857491d2ec 2023-07-22 20:23:50,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/info/c27e37056c984e7bbb9e5a857491d2ec, entries=50, sequenceid=29, filesize=10.6 K 2023-07-22 20:23:50,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/.tmp/table/3b379ad0e55b4a29b34702ea522a7014 as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/table/3b379ad0e55b4a29b34702ea522a7014 2023-07-22 20:23:50,070 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/table/3b379ad0e55b4a29b34702ea522a7014, entries=10, sequenceid=29, filesize=5.1 K 2023-07-22 20:23:50,071 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~6.34 KB/6489, heapSize ~11.23 KB/11504, currentSize=0 B/0 for 1588230740 in 865ms, sequenceid=29, compaction requested=false 2023-07-22 20:23:50,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=830 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/.tmp/q/d8b74e927aee4f318cf6d81572106fa2 2023-07-22 20:23:50,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/meta/1588230740/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-22 20:23:50,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:50,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 20:23:50,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:23:50,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 20:23:50,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 20:23:50,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-22 20:23:50,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8b74e927aee4f318cf6d81572106fa2 2023-07-22 20:23:50,208 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-22 20:23:50,208 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1478): Online Regions={aee51ac7fd428f2b02d86170b5fad455=hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455., 0f3b9459e05cae33b131c77d94b01dd0=hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0., e39f88ae0f2b248ee9cc38d588346818=hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818.} 2023-07-22 20:23:50,208 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on 0f3b9459e05cae33b131c77d94b01dd0, aee51ac7fd428f2b02d86170b5fad455, e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:23:50,408 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on 0f3b9459e05cae33b131c77d94b01dd0, aee51ac7fd428f2b02d86170b5fad455, e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:23:50,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=510 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/.tmp/u/26608d6fd2974ec2a06bfd7481da8666 2023-07-22 20:23:50,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26608d6fd2974ec2a06bfd7481da8666 2023-07-22 20:23:50,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/.tmp/q/d8b74e927aee4f318cf6d81572106fa2 as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/q/d8b74e927aee4f318cf6d81572106fa2 2023-07-22 20:23:50,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8b74e927aee4f318cf6d81572106fa2 2023-07-22 20:23:50,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/q/d8b74e927aee4f318cf6d81572106fa2, entries=8, sequenceid=24, filesize=5.2 K 2023-07-22 20:23:50,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/.tmp/u/26608d6fd2974ec2a06bfd7481da8666 as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/u/26608d6fd2974ec2a06bfd7481da8666 2023-07-22 20:23:50,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26608d6fd2974ec2a06bfd7481da8666 2023-07-22 20:23:50,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/u/26608d6fd2974ec2a06bfd7481da8666, entries=10, sequenceid=24, filesize=5.4 K 2023-07-22 20:23:50,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.31 KB/1340, heapSize ~3.80 KB/3896, currentSize=0 B/0 for aee51ac7fd428f2b02d86170b5fad455 in 850ms, sequenceid=24, compaction requested=false 2023-07-22 20:23:50,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/quota/aee51ac7fd428f2b02d86170b5fad455/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-22 20:23:50,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:50,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:23:50,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:23:50,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aee51ac7fd428f2b02d86170b5fad455: 2023-07-22 20:23:50,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1690057064664.aee51ac7fd428f2b02d86170b5fad455. 2023-07-22 20:23:50,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f3b9459e05cae33b131c77d94b01dd0, disabling compactions & flushes 2023-07-22 20:23:50,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:23:50,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:23:50,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. after waiting 0 ms 2023-07-22 20:23:50,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:23:50,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/default/hbase_shell_quota_tests_table/0f3b9459e05cae33b131c77d94b01dd0/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-22 20:23:50,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:50,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:23:50,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:23:50,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f3b9459e05cae33b131c77d94b01dd0: 2023-07-22 20:23:50,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase_shell_quota_tests_table,,1690057070763.0f3b9459e05cae33b131c77d94b01dd0. 2023-07-22 20:23:50,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e39f88ae0f2b248ee9cc38d588346818, disabling compactions & flushes 2023-07-22 20:23:50,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:23:50,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:23:50,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. after waiting 0 ms 2023-07-22 20:23:50,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:23:50,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e39f88ae0f2b248ee9cc38d588346818 1/1 column families, dataSize=113 B heapSize=520 B 2023-07-22 20:23:50,608 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:23:50,809 DEBUG [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1504): Waiting on e39f88ae0f2b248ee9cc38d588346818 2023-07-22 20:23:50,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=113 B at sequenceid=6 (bloomFilter=false), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818/.tmp/l/8060c68e541f4250adcd09761922e558 2023-07-22 20:23:50,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818/.tmp/l/8060c68e541f4250adcd09761922e558 as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818/l/8060c68e541f4250adcd09761922e558 2023-07-22 20:23:50,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818/l/8060c68e541f4250adcd09761922e558, entries=2, sequenceid=6, filesize=4.7 K 2023-07-22 20:23:50,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~113 B/113, heapSize ~504 B/504, currentSize=0 B/0 for e39f88ae0f2b248ee9cc38d588346818 in 424ms, sequenceid=6, compaction requested=false 2023-07-22 20:23:50,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/data/hbase/acl/e39f88ae0f2b248ee9cc38d588346818/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 20:23:50,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 20:23:50,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-22 20:23:50,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:23:50,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e39f88ae0f2b248ee9cc38d588346818: 2023-07-22 20:23:50,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690057064731.e39f88ae0f2b248ee9cc38d588346818. 2023-07-22 20:23:51,009 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42833,1690057061382; all regions closed. 2023-07-22 20:23:51,009 DEBUG [RS:0;jenkins-hbase4:42833] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-22 20:23:51,021 DEBUG [RS:0;jenkins-hbase4:42833] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/oldWALs 2023-07-22 20:23:51,021 INFO [RS:0;jenkins-hbase4:42833] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42833%2C1690057061382.meta:.meta(num 1690057063658) 2023-07-22 20:23:51,027 DEBUG [RS:0;jenkins-hbase4:42833] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/oldWALs 2023-07-22 20:23:51,027 INFO [RS:0;jenkins-hbase4:42833] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42833%2C1690057061382:(num 1690057063098) 2023-07-22 20:23:51,027 DEBUG [RS:0;jenkins-hbase4:42833] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:23:51,028 INFO [RS:0;jenkins-hbase4:42833] regionserver.LeaseManager(133): Closed leases 2023-07-22 20:23:51,028 INFO [RS:0;jenkins-hbase4:42833] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 20:23:51,028 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 20:23:51,029 INFO [RS:0;jenkins-hbase4:42833] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42833 2023-07-22 20:23:51,040 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 20:23:51,040 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42833,1690057061382 2023-07-22 20:23:51,040 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 20:23:51,040 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42833,1690057061382] 2023-07-22 20:23:51,041 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42833,1690057061382; numProcessing=1 2023-07-22 20:23:51,042 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42833,1690057061382 already deleted, retry=false 2023-07-22 20:23:51,042 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42833,1690057061382 expired; onlineServers=0 2023-07-22 20:23:51,042 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41649,1690057059500' ***** 2023-07-22 20:23:51,042 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-22 20:23:51,043 DEBUG [M:0;jenkins-hbase4:41649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4376d439, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 20:23:51,043 INFO [M:0;jenkins-hbase4:41649] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-22 20:23:51,049 INFO [M:0;jenkins-hbase4:41649] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@11069379{master,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-22 20:23:51,049 INFO [M:0;jenkins-hbase4:41649] server.AbstractConnector(383): Stopped ServerConnector@693001fb{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-22 20:23:51,049 INFO [M:0;jenkins-hbase4:41649] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-22 20:23:51,050 INFO [M:0;jenkins-hbase4:41649] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@67c0cb70{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-22 20:23:51,050 INFO [M:0;jenkins-hbase4:41649] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2c4dd569{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/hadoop.log.dir/,STOPPED} 2023-07-22 20:23:51,051 INFO [M:0;jenkins-hbase4:41649] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41649,1690057059500 2023-07-22 20:23:51,051 INFO [M:0;jenkins-hbase4:41649] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41649,1690057059500; all regions closed. 2023-07-22 20:23:51,051 DEBUG [M:0;jenkins-hbase4:41649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 20:23:51,051 INFO [M:0;jenkins-hbase4:41649] master.HMaster(1491): Stopping master jetty server 2023-07-22 20:23:51,051 INFO [M:0;jenkins-hbase4:41649] server.AbstractConnector(383): Stopped ServerConnector@6e979980{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-22 20:23:51,051 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-22 20:23:51,052 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 20:23:51,052 DEBUG [M:0;jenkins-hbase4:41649] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-22 20:23:51,052 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-22 20:23:51,052 DEBUG [M:0;jenkins-hbase4:41649] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-22 20:23:51,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690057062781] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690057062781,5,FailOnTimeoutGroup] 2023-07-22 20:23:51,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 20:23:51,052 INFO [M:0;jenkins-hbase4:41649] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-22 20:23:51,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690057062781] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690057062781,5,FailOnTimeoutGroup] 2023-07-22 20:23:51,052 INFO [M:0;jenkins-hbase4:41649] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-22 20:23:51,053 INFO [M:0;jenkins-hbase4:41649] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 20:23:51,053 DEBUG [M:0;jenkins-hbase4:41649] master.HMaster(1512): Stopping service threads 2023-07-22 20:23:51,053 INFO [M:0;jenkins-hbase4:41649] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-22 20:23:51,054 INFO [M:0;jenkins-hbase4:41649] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-22 20:23:51,054 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-22 20:23:51,054 DEBUG [M:0;jenkins-hbase4:41649] zookeeper.ZKUtil(398): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-22 20:23:51,054 WARN [M:0;jenkins-hbase4:41649] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-22 20:23:51,054 INFO [M:0;jenkins-hbase4:41649] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-22 20:23:51,055 INFO [M:0;jenkins-hbase4:41649] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-22 20:23:51,055 DEBUG [M:0;jenkins-hbase4:41649] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 20:23:51,055 INFO [M:0;jenkins-hbase4:41649] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 20:23:51,055 DEBUG [M:0;jenkins-hbase4:41649] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 20:23:51,055 DEBUG [M:0;jenkins-hbase4:41649] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 20:23:51,055 DEBUG [M:0;jenkins-hbase4:41649] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 20:23:51,055 INFO [M:0;jenkins-hbase4:41649] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=95.75 KB heapSize=115.68 KB 2023-07-22 20:23:51,069 INFO [M:0;jenkins-hbase4:41649] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=95.75 KB at sequenceid=237 (bloomFilter=true), to=hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5417ac24540c463dbd076a9db99f18ad 2023-07-22 20:23:51,075 INFO [M:0;jenkins-hbase4:41649] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5417ac24540c463dbd076a9db99f18ad 2023-07-22 20:23:51,076 DEBUG [M:0;jenkins-hbase4:41649] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5417ac24540c463dbd076a9db99f18ad as hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5417ac24540c463dbd076a9db99f18ad 2023-07-22 20:23:51,081 INFO [M:0;jenkins-hbase4:41649] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5417ac24540c463dbd076a9db99f18ad 2023-07-22 20:23:51,082 INFO [M:0;jenkins-hbase4:41649] regionserver.HStore(1080): Added hdfs://localhost:35725/user/jenkins/test-data/e66fb7c4-4012-918f-a50f-aba97046b970/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5417ac24540c463dbd076a9db99f18ad, entries=28, sequenceid=237, filesize=7.7 K 2023-07-22 20:23:51,083 INFO [M:0;jenkins-hbase4:41649] regionserver.HRegion(2948): Finished flush of dataSize ~95.75 KB/98050, heapSize ~115.66 KB/118440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=237, compaction requested=false 2023-07-22 20:23:51,084 INFO [M:0;jenkins-hbase4:41649] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 20:23:51,084 DEBUG [M:0;jenkins-hbase4:41649] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 20:23:51,087 INFO [M:0;jenkins-hbase4:41649] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-22 20:23:51,087 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 20:23:51,088 INFO [M:0;jenkins-hbase4:41649] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41649 2023-07-22 20:23:51,089 DEBUG [M:0;jenkins-hbase4:41649] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41649,1690057059500 already deleted, retry=false 2023-07-22 20:23:51,142 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 20:23:51,142 INFO [RS:0;jenkins-hbase4:42833] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42833,1690057061382; zookeeper connection closed. 2023-07-22 20:23:51,142 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): regionserver:42833-0x1018eaeac2f0001, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 20:23:51,142 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e8b405d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e8b405d 2023-07-22 20:23:51,142 INFO [Listener at localhost/40721] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-22 20:23:51,242 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 20:23:51,242 INFO [M:0;jenkins-hbase4:41649] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41649,1690057059500; zookeeper connection closed. 2023-07-22 20:23:51,242 DEBUG [Listener at localhost/40721-EventThread] zookeeper.ZKWatcher(600): master:41649-0x1018eaeac2f0000, quorum=127.0.0.1:61246, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 20:23:51,243 WARN [Listener at localhost/40721] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 20:23:51,246 INFO [Listener at localhost/40721] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 20:23:51,351 WARN [BP-652243659-172.31.14.131-1690057056392 heartbeating to localhost/127.0.0.1:35725] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 20:23:51,351 WARN [BP-652243659-172.31.14.131-1690057056392 heartbeating to localhost/127.0.0.1:35725] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-652243659-172.31.14.131-1690057056392 (Datanode Uuid 35cce8cb-9370-4e5c-8b1c-2574ef853915) service to localhost/127.0.0.1:35725 2023-07-22 20:23:51,352 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/cluster_9554e79a-d920-85e6-3f8e-f0796f7f4da8/dfs/data/data1/current/BP-652243659-172.31.14.131-1690057056392] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 20:23:51,353 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/dc42ddfc-cbf8-0af6-550b-8038ed9db1e2/cluster_9554e79a-d920-85e6-3f8e-f0796f7f4da8/dfs/data/data2/current/BP-652243659-172.31.14.131-1690057056392] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 20:23:51,388 INFO [Listener at localhost/40721] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 20:23:51,499 INFO [Listener at localhost/40721] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-22 20:23:51,522 INFO [Listener at localhost/40721] hbase.HBaseTestingUtility(1293): Minicluster is down