2023-07-21 16:22:51,085 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f 2023-07-21 16:22:51,196 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestQuotasShell timeout: 13 mins 2023-07-21 16:22:51,334 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-21 16:22:51,446 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-21 16:22:51,446 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/cluster_bb11de44-9ffb-d664-f1e8-4a0f6272fb5a, deleteOnExit=true 2023-07-21 16:22:51,446 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-21 16:22:51,447 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/test.cache.data in system properties and HBase conf 2023-07-21 16:22:51,447 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 16:22:51,447 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/hadoop.log.dir in system properties and HBase conf 2023-07-21 16:22:51,448 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 16:22:51,448 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 16:22:51,448 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 16:22:51,718 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-21 16:22:51,723 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 16:22:51,723 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 16:22:51,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 16:22:51,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 16:22:51,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 16:22:51,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 16:22:51,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 16:22:51,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 16:22:51,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 16:22:51,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/nfs.dump.dir in system properties and HBase conf 2023-07-21 16:22:51,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/java.io.tmpdir in system properties and HBase conf 2023-07-21 16:22:51,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 16:22:51,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 16:22:51,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-21 16:22:52,216 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 16:22:52,220 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 16:22:52,524 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-21 16:22:52,677 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-21 16:22:52,690 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 16:22:52,722 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 16:22:52,755 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/java.io.tmpdir/Jetty_localhost_38695_hdfs____.6esefd/webapp 2023-07-21 16:22:52,902 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38695 2023-07-21 16:22:52,924 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 16:22:52,924 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 16:22:53,353 WARN [Listener at localhost/42781] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 16:22:53,548 WARN [Listener at localhost/42781] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 16:22:53,565 WARN [Listener at localhost/42781] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 16:22:53,570 INFO [Listener at localhost/42781] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 16:22:53,574 INFO [Listener at localhost/42781] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/java.io.tmpdir/Jetty_localhost_37055_datanode____7nepcj/webapp 2023-07-21 16:22:53,674 INFO [Listener at localhost/42781] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37055 2023-07-21 16:22:53,896 WARN [Listener at localhost/39229] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 16:22:54,292 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfc9e63c5227c4cd2: Processing first storage report for DS-88661f6d-ab08-4503-b91c-8fa338f9e1c6 from datanode 6e08a263-a035-4a6d-ad89-02dfa6f99aab 2023-07-21 16:22:54,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfc9e63c5227c4cd2: from storage DS-88661f6d-ab08-4503-b91c-8fa338f9e1c6 node DatanodeRegistration(127.0.0.1:43843, datanodeUuid=6e08a263-a035-4a6d-ad89-02dfa6f99aab, infoPort=32997, infoSecurePort=0, ipcPort=39229, storageInfo=lv=-57;cid=testClusterID;nsid=948766126;c=1689956572303), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-21 16:22:54,294 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfc9e63c5227c4cd2: Processing first storage report for DS-c757608b-171f-4da0-9885-348cc3f436a5 from datanode 6e08a263-a035-4a6d-ad89-02dfa6f99aab 2023-07-21 16:22:54,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfc9e63c5227c4cd2: from storage DS-c757608b-171f-4da0-9885-348cc3f436a5 node DatanodeRegistration(127.0.0.1:43843, datanodeUuid=6e08a263-a035-4a6d-ad89-02dfa6f99aab, infoPort=32997, infoSecurePort=0, ipcPort=39229, storageInfo=lv=-57;cid=testClusterID;nsid=948766126;c=1689956572303), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 16:22:54,353 DEBUG [Listener at localhost/39229] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f 2023-07-21 16:22:54,430 INFO [Listener at localhost/39229] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/cluster_bb11de44-9ffb-d664-f1e8-4a0f6272fb5a/zookeeper_0, clientPort=62202, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/cluster_bb11de44-9ffb-d664-f1e8-4a0f6272fb5a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/cluster_bb11de44-9ffb-d664-f1e8-4a0f6272fb5a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-21 16:22:54,445 INFO [Listener at localhost/39229] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62202 2023-07-21 16:22:54,457 INFO [Listener at localhost/39229] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 16:22:54,459 INFO [Listener at localhost/39229] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 16:22:55,151 INFO [Listener at localhost/39229] util.FSUtils(471): Created version file at hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb with version=8 2023-07-21 16:22:55,152 INFO [Listener at localhost/39229] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/hbase-staging 2023-07-21 16:22:55,169 DEBUG [Listener at localhost/39229] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-21 16:22:55,170 DEBUG [Listener at localhost/39229] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-21 16:22:55,533 INFO [Listener at localhost/39229] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-21 16:22:56,057 INFO [Listener at localhost/39229] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=18 2023-07-21 16:22:56,091 INFO [Listener at localhost/39229] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 16:22:56,092 INFO [Listener at localhost/39229] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 16:22:56,092 INFO [Listener at localhost/39229] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 16:22:56,092 INFO [Listener at localhost/39229] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 16:22:56,092 INFO [Listener at localhost/39229] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 16:22:56,255 INFO [Listener at localhost/39229] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 16:22:56,334 DEBUG [Listener at localhost/39229] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-21 16:22:56,432 INFO [Listener at localhost/39229] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37367 2023-07-21 16:22:56,445 INFO [Listener at localhost/39229] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 16:22:56,447 INFO [Listener at localhost/39229] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 16:22:56,472 INFO [Listener at localhost/39229] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37367 connecting to ZooKeeper ensemble=127.0.0.1:62202 2023-07-21 16:22:56,517 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:373670x0, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 16:22:56,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37367-0x10188b167cc0000 connected 2023-07-21 16:22:56,552 DEBUG [Listener at localhost/39229] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 16:22:56,553 DEBUG [Listener at localhost/39229] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 16:22:56,567 DEBUG [Listener at localhost/39229] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 16:22:56,576 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37367 2023-07-21 16:22:56,576 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37367 2023-07-21 16:22:56,576 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37367 2023-07-21 16:22:56,577 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37367 2023-07-21 16:22:56,577 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37367 2023-07-21 16:22:56,612 INFO [Listener at localhost/39229] log.Log(170): Logging initialized @6133ms to org.apache.hbase.thirdparty.org.eclipse.jetty.util.log.Slf4jLog 2023-07-21 16:22:56,742 INFO [Listener at localhost/39229] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-21 16:22:56,742 INFO [Listener at localhost/39229] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-21 16:22:56,743 INFO [Listener at localhost/39229] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-21 16:22:56,745 INFO [Listener at localhost/39229] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-21 16:22:56,745 INFO [Listener at localhost/39229] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-21 16:22:56,745 INFO [Listener at localhost/39229] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-21 16:22:56,749 INFO [Listener at localhost/39229] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-21 16:22:56,812 INFO [Listener at localhost/39229] http.HttpServer(1146): Jetty bound to port 45007 2023-07-21 16:22:56,815 INFO [Listener at localhost/39229] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-21 16:22:56,843 INFO [Listener at localhost/39229] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-21 16:22:56,846 INFO [Listener at localhost/39229] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@aeaf545{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/hadoop.log.dir/,AVAILABLE} 2023-07-21 16:22:56,847 INFO [Listener at localhost/39229] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-21 16:22:56,847 INFO [Listener at localhost/39229] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@6b98d438{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-21 16:22:57,040 INFO [Listener at localhost/39229] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-21 16:22:57,057 INFO [Listener at localhost/39229] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-21 16:22:57,058 INFO [Listener at localhost/39229] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-21 16:22:57,061 INFO [Listener at localhost/39229] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-21 16:22:57,071 INFO [Listener at localhost/39229] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-21 16:22:57,108 INFO [Listener at localhost/39229] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@9b5a588{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/java.io.tmpdir/jetty-0_0_0_0-45007-hbase-server-2_4_18-SNAPSHOT_jar-_-any-8416396860680954797/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-21 16:22:57,124 INFO [Listener at localhost/39229] server.AbstractConnector(333): Started ServerConnector@64c7330a{HTTP/1.1, (http/1.1)}{0.0.0.0:45007} 2023-07-21 16:22:57,125 INFO [Listener at localhost/39229] server.Server(415): Started @6646ms 2023-07-21 16:22:57,130 INFO [Listener at localhost/39229] master.HMaster(444): hbase.rootdir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb, hbase.cluster.distributed=false 2023-07-21 16:22:57,214 INFO [Listener at localhost/39229] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=18 2023-07-21 16:22:57,215 INFO [Listener at localhost/39229] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 16:22:57,215 INFO [Listener at localhost/39229] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 16:22:57,215 INFO [Listener at localhost/39229] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 16:22:57,215 INFO [Listener at localhost/39229] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 16:22:57,215 INFO [Listener at localhost/39229] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 16:22:57,221 INFO [Listener at localhost/39229] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 16:22:57,225 INFO [Listener at localhost/39229] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45305 2023-07-21 16:22:57,229 INFO [Listener at localhost/39229] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 16:22:57,238 DEBUG [Listener at localhost/39229] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 16:22:57,239 INFO [Listener at localhost/39229] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 16:22:57,243 INFO [Listener at localhost/39229] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 16:22:57,246 INFO [Listener at localhost/39229] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45305 connecting to ZooKeeper ensemble=127.0.0.1:62202 2023-07-21 16:22:57,270 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:453050x0, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 16:22:57,271 DEBUG [Listener at localhost/39229] zookeeper.ZKUtil(164): regionserver:453050x0, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 16:22:57,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45305-0x10188b167cc0001 connected 2023-07-21 16:22:57,273 DEBUG [Listener at localhost/39229] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 16:22:57,274 DEBUG [Listener at localhost/39229] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 16:22:57,279 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45305 2023-07-21 16:22:57,279 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45305 2023-07-21 16:22:57,279 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45305 2023-07-21 16:22:57,287 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45305 2023-07-21 16:22:57,287 DEBUG [Listener at localhost/39229] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45305 2023-07-21 16:22:57,291 INFO [Listener at localhost/39229] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-21 16:22:57,291 INFO [Listener at localhost/39229] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-21 16:22:57,291 INFO [Listener at localhost/39229] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-21 16:22:57,293 INFO [Listener at localhost/39229] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-21 16:22:57,293 INFO [Listener at localhost/39229] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-21 16:22:57,293 INFO [Listener at localhost/39229] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-21 16:22:57,293 INFO [Listener at localhost/39229] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-21 16:22:57,296 INFO [Listener at localhost/39229] http.HttpServer(1146): Jetty bound to port 45595 2023-07-21 16:22:57,296 INFO [Listener at localhost/39229] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-21 16:22:57,336 INFO [Listener at localhost/39229] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-21 16:22:57,337 INFO [Listener at localhost/39229] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@6161fd4a{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/hadoop.log.dir/,AVAILABLE} 2023-07-21 16:22:57,337 INFO [Listener at localhost/39229] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-21 16:22:57,337 INFO [Listener at localhost/39229] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2b99c003{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-21 16:22:57,460 INFO [Listener at localhost/39229] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-21 16:22:57,461 INFO [Listener at localhost/39229] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-21 16:22:57,461 INFO [Listener at localhost/39229] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-21 16:22:57,462 INFO [Listener at localhost/39229] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-21 16:22:57,463 INFO [Listener at localhost/39229] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-21 16:22:57,467 INFO [Listener at localhost/39229] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@412c0e46{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/java.io.tmpdir/jetty-0_0_0_0-45595-hbase-server-2_4_18-SNAPSHOT_jar-_-any-2230301709039010392/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-21 16:22:57,468 INFO [Listener at localhost/39229] server.AbstractConnector(333): Started ServerConnector@697897c8{HTTP/1.1, (http/1.1)}{0.0.0.0:45595} 2023-07-21 16:22:57,469 INFO [Listener at localhost/39229] server.Server(415): Started @6990ms 2023-07-21 16:22:57,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-21 16:22:57,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@2fc2c814{HTTP/1.1, (http/1.1)}{0.0.0.0:35353} 2023-07-21 16:22:57,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(415): Started @7000ms 2023-07-21 16:22:57,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:22:57,489 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 16:22:57,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:22:57,511 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 16:22:57,511 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 16:22:57,511 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:22:57,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 16:22:57,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37367,1689956575349 from backup master directory 2023-07-21 16:22:57,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 16:22:57,516 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:22:57,516 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 16:22:57,517 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 16:22:57,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:22:57,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-21 16:22:57,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-21 16:22:57,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/hbase.id with ID: 9887c3bf-931e-4ce4-b4f0-21b8884ef47d 2023-07-21 16:22:57,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 16:22:57,673 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:22:57,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x62b33f68 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:22:57,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5084ac51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:22:57,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 16:22:57,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-21 16:22:57,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-21 16:22:57,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-21 16:22:57,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 16:22:57,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 16:22:57,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 16:22:57,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store-tmp 2023-07-21 16:22:57,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:22:57,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 16:22:57,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 16:22:57,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 16:22:57,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 16:22:57,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 16:22:57,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 16:22:57,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 16:22:57,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/WALs/jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:22:57,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37367%2C1689956575349, suffix=, logDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/WALs/jenkins-hbase4.apache.org,37367,1689956575349, archiveDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/oldWALs, maxLogs=10 2023-07-21 16:22:57,964 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43843,DS-88661f6d-ab08-4503-b91c-8fa338f9e1c6,DISK] 2023-07-21 16:22:57,972 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-21 16:22:58,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/WALs/jenkins-hbase4.apache.org,37367,1689956575349/jenkins-hbase4.apache.org%2C37367%2C1689956575349.1689956577907 2023-07-21 16:22:58,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43843,DS-88661f6d-ab08-4503-b91c-8fa338f9e1c6,DISK]] 2023-07-21 16:22:58,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-21 16:22:58,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:22:58,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 16:22:58,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 16:22:58,122 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-21 16:22:58,129 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-21 16:22:58,167 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-21 16:22:58,180 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:22:58,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 16:22:58,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 16:22:58,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 16:22:58,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 16:22:58,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11296373280, jitterRate=0.05205674469470978}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 16:22:58,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 16:22:58,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-21 16:22:58,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-21 16:22:58,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-21 16:22:58,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-21 16:22:58,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-21 16:22:58,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-21 16:22:58,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-21 16:22:58,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-21 16:22:58,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-21 16:22:58,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-21 16:22:58,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-21 16:22:58,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-21 16:22:58,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-21 16:22:58,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-21 16:22:58,371 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:22:58,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-21 16:22:58,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-21 16:22:58,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-21 16:22:58,392 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 16:22:58,392 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 16:22:58,392 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:22:58,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37367,1689956575349, sessionid=0x10188b167cc0000, setting cluster-up flag (Was=false) 2023-07-21 16:22:58,412 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:22:58,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-21 16:22:58,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:22:58,425 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:22:58,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-21 16:22:58,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:22:58,435 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp 2023-07-21 16:22:58,474 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(951): ClusterId : 9887c3bf-931e-4ce4-b4f0-21b8884ef47d 2023-07-21 16:22:58,482 DEBUG [RS:0;jenkins-hbase4:45305] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 16:22:58,488 DEBUG [RS:0;jenkins-hbase4:45305] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 16:22:58,488 DEBUG [RS:0;jenkins-hbase4:45305] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 16:22:58,491 DEBUG [RS:0;jenkins-hbase4:45305] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 16:22:58,492 DEBUG [RS:0;jenkins-hbase4:45305] zookeeper.ReadOnlyZKClient(139): Connect 0x787a51cc to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:22:58,502 DEBUG [RS:0;jenkins-hbase4:45305] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@302c6aae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:22:58,503 DEBUG [RS:0;jenkins-hbase4:45305] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67a3d6fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 16:22:58,529 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45305 2023-07-21 16:22:58,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-21 16:22:58,535 INFO [RS:0;jenkins-hbase4:45305] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 16:22:58,536 INFO [RS:0;jenkins-hbase4:45305] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 16:22:58,536 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 16:22:58,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 16:22:58,537 INFO [RS:0;jenkins-hbase4:45305] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 16:22:58,537 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 16:22:58,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-21 16:22:58,540 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37367,1689956575349 with isa=jenkins-hbase4.apache.org/172.31.14.131:45305, startcode=1689956577214 2023-07-21 16:22:58,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=VisibilityLabelsService 2023-07-21 16:22:58,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870913. 2023-07-21 16:22:58,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870914. 2023-07-21 16:22:58,557 DEBUG [RS:0;jenkins-hbase4:45305] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 16:22:58,614 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54967, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 16:22:58,622 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37367] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 16:22:58,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-21 16:22:58,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 16:22:58,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 16:22:58,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 16:22:58,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 16:22:58,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-21 16:22:58,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 16:22:58,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689956608639 2023-07-21 16:22:58,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-21 16:22:58,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-21 16:22:58,646 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 16:22:58,647 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-21 16:22:58,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-21 16:22:58,651 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 16:22:58,651 WARN [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 16:22:58,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-21 16:22:58,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-21 16:22:58,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-21 16:22:58,652 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 16:22:58,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-21 16:22:58,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-21 16:22:58,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-21 16:22:58,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-21 16:22:58,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-21 16:22:58,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689956578660,5,FailOnTimeoutGroup] 2023-07-21 16:22:58,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689956578660,5,FailOnTimeoutGroup] 2023-07-21 16:22:58,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-21 16:22:58,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,679 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 16:22:58,680 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 16:22:58,680 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb 2023-07-21 16:22:58,691 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:22:58,693 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 16:22:58,696 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/info 2023-07-21 16:22:58,696 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 16:22:58,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:22:58,698 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 16:22:58,700 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/rep_barrier 2023-07-21 16:22:58,701 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 16:22:58,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:22:58,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 16:22:58,704 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/table 2023-07-21 16:22:58,704 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 16:22:58,705 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:22:58,707 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740 2023-07-21 16:22:58,707 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740 2023-07-21 16:22:58,711 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 16:22:58,713 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 16:22:58,716 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 16:22:58,717 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11630086400, jitterRate=0.08313620090484619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 16:22:58,717 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 16:22:58,717 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 16:22:58,717 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 16:22:58,717 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 16:22:58,718 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 16:22:58,718 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 16:22:58,719 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 16:22:58,719 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 16:22:58,723 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 16:22:58,723 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-21 16:22:58,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-21 16:22:58,742 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-21 16:22:58,745 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-21 16:22:58,752 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37367,1689956575349 with isa=jenkins-hbase4.apache.org/172.31.14.131:45305, startcode=1689956577214 2023-07-21 16:22:58,756 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37367] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:22:58,764 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb 2023-07-21 16:22:58,764 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42781 2023-07-21 16:22:58,764 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=45007 2023-07-21 16:22:58,770 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 16:22:58,771 DEBUG [RS:0;jenkins-hbase4:45305] zookeeper.ZKUtil(162): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:22:58,771 WARN [RS:0;jenkins-hbase4:45305] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 16:22:58,771 INFO [RS:0;jenkins-hbase4:45305] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 16:22:58,772 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/WALs/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:22:58,772 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45305,1689956577214] 2023-07-21 16:22:58,780 DEBUG [RS:0;jenkins-hbase4:45305] zookeeper.ZKUtil(162): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:22:58,792 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 16:22:58,801 INFO [RS:0;jenkins-hbase4:45305] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 16:22:58,823 INFO [RS:0;jenkins-hbase4:45305] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 16:22:58,827 INFO [RS:0;jenkins-hbase4:45305] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 16:22:58,827 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,828 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 16:22:58,837 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,837 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,837 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,837 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,837 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,838 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,838 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 16:22:58,838 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,838 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,838 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,838 DEBUG [RS:0;jenkins-hbase4:45305] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 16:22:58,839 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,839 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,839 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,839 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,854 INFO [RS:0;jenkins-hbase4:45305] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 16:22:58,857 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45305,1689956577214-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,874 INFO [RS:0;jenkins-hbase4:45305] regionserver.Replication(203): jenkins-hbase4.apache.org,45305,1689956577214 started 2023-07-21 16:22:58,874 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45305,1689956577214, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45305, sessionid=0x10188b167cc0001 2023-07-21 16:22:58,874 DEBUG [RS:0;jenkins-hbase4:45305] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 16:22:58,874 DEBUG [RS:0;jenkins-hbase4:45305] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:22:58,874 DEBUG [RS:0;jenkins-hbase4:45305] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45305,1689956577214' 2023-07-21 16:22:58,874 DEBUG [RS:0;jenkins-hbase4:45305] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 16:22:58,875 DEBUG [RS:0;jenkins-hbase4:45305] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 16:22:58,875 DEBUG [RS:0;jenkins-hbase4:45305] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 16:22:58,875 DEBUG [RS:0;jenkins-hbase4:45305] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 16:22:58,876 DEBUG [RS:0;jenkins-hbase4:45305] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:22:58,876 DEBUG [RS:0;jenkins-hbase4:45305] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45305,1689956577214' 2023-07-21 16:22:58,876 DEBUG [RS:0;jenkins-hbase4:45305] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 16:22:58,876 DEBUG [RS:0;jenkins-hbase4:45305] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 16:22:58,877 DEBUG [RS:0;jenkins-hbase4:45305] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 16:22:58,877 INFO [RS:0;jenkins-hbase4:45305] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-21 16:22:58,879 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,879 DEBUG [RS:0;jenkins-hbase4:45305] zookeeper.ZKUtil(398): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-21 16:22:58,880 INFO [RS:0;jenkins-hbase4:45305] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-21 16:22:58,880 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,880 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:58,896 DEBUG [jenkins-hbase4:37367] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-21 16:22:58,900 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45305,1689956577214, state=OPENING 2023-07-21 16:22:58,906 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-21 16:22:58,908 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:22:58,908 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 16:22:58,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45305,1689956577214}] 2023-07-21 16:22:58,993 INFO [RS:0;jenkins-hbase4:45305] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45305%2C1689956577214, suffix=, logDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/WALs/jenkins-hbase4.apache.org,45305,1689956577214, archiveDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/oldWALs, maxLogs=32 2023-07-21 16:22:59,011 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43843,DS-88661f6d-ab08-4503-b91c-8fa338f9e1c6,DISK] 2023-07-21 16:22:59,014 INFO [RS:0;jenkins-hbase4:45305] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/WALs/jenkins-hbase4.apache.org,45305,1689956577214/jenkins-hbase4.apache.org%2C45305%2C1689956577214.1689956578995 2023-07-21 16:22:59,015 DEBUG [RS:0;jenkins-hbase4:45305] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43843,DS-88661f6d-ab08-4503-b91c-8fa338f9e1c6,DISK]] 2023-07-21 16:22:59,096 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:22:59,098 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 16:22:59,102 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 16:22:59,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-21 16:22:59,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 16:22:59,117 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45305%2C1689956577214.meta, suffix=.meta, logDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/WALs/jenkins-hbase4.apache.org,45305,1689956577214, archiveDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/oldWALs, maxLogs=32 2023-07-21 16:22:59,140 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43843,DS-88661f6d-ab08-4503-b91c-8fa338f9e1c6,DISK] 2023-07-21 16:22:59,145 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/WALs/jenkins-hbase4.apache.org,45305,1689956577214/jenkins-hbase4.apache.org%2C45305%2C1689956577214.meta.1689956579119.meta 2023-07-21 16:22:59,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43843,DS-88661f6d-ab08-4503-b91c-8fa338f9e1c6,DISK]] 2023-07-21 16:22:59,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-21 16:22:59,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-21 16:22:59,149 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 16:22:59,149 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=VisibilityLabelsService 2023-07-21 16:22:59,157 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-21 16:22:59,158 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-21 16:22:59,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-21 16:22:59,161 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-21 16:22:59,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-21 16:22:59,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:22:59,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-21 16:22:59,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-21 16:22:59,179 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 16:22:59,180 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/info 2023-07-21 16:22:59,181 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/info 2023-07-21 16:22:59,181 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 16:22:59,182 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:22:59,182 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 16:22:59,184 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/rep_barrier 2023-07-21 16:22:59,184 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/rep_barrier 2023-07-21 16:22:59,184 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 16:22:59,185 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:22:59,185 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 16:22:59,187 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/table 2023-07-21 16:22:59,187 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/table 2023-07-21 16:22:59,187 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 16:22:59,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:22:59,190 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740 2023-07-21 16:22:59,193 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740 2023-07-21 16:22:59,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 16:22:59,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 16:22:59,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10101653280, jitterRate=-0.05921022593975067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 16:22:59,208 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:22:59,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 16:22:59,227 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689956579088 2023-07-21 16:22:59,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-21 16:22:59,246 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-21 16:22:59,247 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45305,1689956577214, state=OPEN 2023-07-21 16:22:59,253 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-21 16:22:59,253 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 16:22:59,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-21 16:22:59,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45305,1689956577214 in 341 msec 2023-07-21 16:22:59,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-21 16:22:59,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 528 msec 2023-07-21 16:22:59,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 716 msec 2023-07-21 16:22:59,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689956579269, completionTime=-1 2023-07-21 16:22:59,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-21 16:22:59,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-21 16:22:59,338 DEBUG [hconnection-0x52d6c371-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:22:59,343 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:22:59,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-21 16:22:59,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689956639367 2023-07-21 16:22:59,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689956699367 2023-07-21 16:22:59,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 97 msec 2023-07-21 16:22:59,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37367,1689956575349-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:59,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37367,1689956575349-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:59,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37367,1689956575349-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:59,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37367, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:59,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-21 16:22:59,402 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-21 16:22:59,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-21 16:22:59,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 16:22:59,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-21 16:22:59,424 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 16:22:59,427 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 16:22:59,449 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:22:59,452 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7 empty. 2023-07-21 16:22:59,453 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:22:59,453 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-21 16:22:59,878 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-21 16:22:59,881 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b3c00b56f24ee908925afac0f15a0d7, NAME => 'hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp 2023-07-21 16:23:00,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:00,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5b3c00b56f24ee908925afac0f15a0d7, disabling compactions & flushes 2023-07-21 16:23:00,297 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:23:00,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:23:00,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. after waiting 0 ms 2023-07-21 16:23:00,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:23:00,297 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:23:00,297 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5b3c00b56f24ee908925afac0f15a0d7: 2023-07-21 16:23:00,302 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 16:23:00,320 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689956580306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689956580306"}]},"ts":"1689956580306"} 2023-07-21 16:23:00,348 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 16:23:00,350 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 16:23:00,354 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956580350"}]},"ts":"1689956580350"} 2023-07-21 16:23:00,359 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-21 16:23:00,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5b3c00b56f24ee908925afac0f15a0d7, ASSIGN}] 2023-07-21 16:23:00,368 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5b3c00b56f24ee908925afac0f15a0d7, ASSIGN 2023-07-21 16:23:00,370 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5b3c00b56f24ee908925afac0f15a0d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45305,1689956577214; forceNewPlan=false, retain=false 2023-07-21 16:23:00,521 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5b3c00b56f24ee908925afac0f15a0d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:00,522 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689956580521"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689956580521"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689956580521"}]},"ts":"1689956580521"} 2023-07-21 16:23:00,527 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5b3c00b56f24ee908925afac0f15a0d7, server=jenkins-hbase4.apache.org,45305,1689956577214}] 2023-07-21 16:23:00,688 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:23:00,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b3c00b56f24ee908925afac0f15a0d7, NAME => 'hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7.', STARTKEY => '', ENDKEY => ''} 2023-07-21 16:23:00,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. service=AccessControlService 2023-07-21 16:23:00,690 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 16:23:00,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. service=VisibilityLabelsService 2023-07-21 16:23:00,691 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-21 16:23:00,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:23:00,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:00,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:23:00,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:23:00,693 INFO [StoreOpener-5b3c00b56f24ee908925afac0f15a0d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:23:00,696 DEBUG [StoreOpener-5b3c00b56f24ee908925afac0f15a0d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7/info 2023-07-21 16:23:00,696 DEBUG [StoreOpener-5b3c00b56f24ee908925afac0f15a0d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7/info 2023-07-21 16:23:00,696 INFO [StoreOpener-5b3c00b56f24ee908925afac0f15a0d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b3c00b56f24ee908925afac0f15a0d7 columnFamilyName info 2023-07-21 16:23:00,697 INFO [StoreOpener-5b3c00b56f24ee908925afac0f15a0d7-1] regionserver.HStore(310): Store=5b3c00b56f24ee908925afac0f15a0d7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:23:00,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:23:00,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:23:00,705 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:23:00,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 16:23:00,709 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b3c00b56f24ee908925afac0f15a0d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11505683520, jitterRate=0.07155027985572815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 16:23:00,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b3c00b56f24ee908925afac0f15a0d7: 2023-07-21 16:23:00,712 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7., pid=6, masterSystemTime=1689956580681 2023-07-21 16:23:00,717 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:23:00,717 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:23:00,718 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5b3c00b56f24ee908925afac0f15a0d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:00,719 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689956580717"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689956580717"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689956580717"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689956580717"}]},"ts":"1689956580717"} 2023-07-21 16:23:00,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-21 16:23:00,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5b3c00b56f24ee908925afac0f15a0d7, server=jenkins-hbase4.apache.org,45305,1689956577214 in 196 msec 2023-07-21 16:23:00,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-21 16:23:00,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5b3c00b56f24ee908925afac0f15a0d7, ASSIGN in 361 msec 2023-07-21 16:23:00,733 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 16:23:00,734 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956580733"}]},"ts":"1689956580733"} 2023-07-21 16:23:00,737 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-21 16:23:00,741 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 16:23:00,745 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3280 sec 2023-07-21 16:23:00,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-21 16:23:00,827 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-21 16:23:00,827 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:23:00,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-21 16:23:00,888 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 16:23:00,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-07-21 16:23:00,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-21 16:23:00,918 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 16:23:00,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-21 16:23:00,931 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-21 16:23:00,933 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-21 16:23:00,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.417sec 2023-07-21 16:23:00,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2023-07-21 16:23:00,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 16:23:00,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2023-07-21 16:23:00,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2023-07-21 16:23:00,941 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 16:23:00,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2023-07-21 16:23:00,942 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 16:23:00,945 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/quota/0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:00,946 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/quota/0d3c535f901a63578debd9c638887d65 empty. 2023-07-21 16:23:00,948 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/quota/0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:00,948 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2023-07-21 16:23:00,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2023-07-21 16:23:00,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2023-07-21 16:23:00,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 16:23:00,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 16:23:00,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-21 16:23:00,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-21 16:23:00,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37367,1689956575349-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-21 16:23:00,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37367,1689956575349-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-21 16:23:00,977 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2023-07-21 16:23:00,981 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0d3c535f901a63578debd9c638887d65, NAME => 'hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp 2023-07-21 16:23:00,982 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x5d91bf1c to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:00,987 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@760bf804, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:01,004 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:01,005 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 0d3c535f901a63578debd9c638887d65, disabling compactions & flushes 2023-07-21 16:23:01,005 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:23:01,005 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:23:01,005 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. after waiting 0 ms 2023-07-21 16:23:01,005 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:23:01,005 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:23:01,005 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 0d3c535f901a63578debd9c638887d65: 2023-07-21 16:23:01,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 16:23:01,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-21 16:23:01,009 DEBUG [hconnection-0x442adbea-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:01,010 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 16:23:01,010 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 16:23:01,011 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689956581011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689956581011"}]},"ts":"1689956581011"} 2023-07-21 16:23:01,011 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 16:23:01,015 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 16:23:01,016 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 10 2023-07-21 16:23:01,017 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 16:23:01,017 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264 empty. 2023-07-21 16:23:01,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956581017"}]},"ts":"1689956581017"} 2023-07-21 16:23:01,017 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,018 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-21 16:23:01,019 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2023-07-21 16:23:01,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-21 16:23:01,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=0d3c535f901a63578debd9c638887d65, ASSIGN}] 2023-07-21 16:23:01,028 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:01,031 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=0d3c535f901a63578debd9c638887d65, ASSIGN 2023-07-21 16:23:01,070 INFO [Listener at localhost/39229] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:23:01,070 DEBUG [Listener at localhost/39229] client.AbstractTestShell(63): Configure jruby runtime, cluster set to org.apache.hadoop.hbase.HBaseTestingUtility@130289a7 2023-07-21 16:23:01,072 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=0d3c535f901a63578debd9c638887d65, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45305,1689956577214; forceNewPlan=false, retain=false 2023-07-21 16:23:01,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0d3c535f901a63578debd9c638887d65, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:01,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689956581222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689956581222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689956581222"}]},"ts":"1689956581222"} 2023-07-21 16:23:01,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 0d3c535f901a63578debd9c638887d65, server=jenkins-hbase4.apache.org,45305,1689956577214}] 2023-07-21 16:23:01,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-21 16:23:01,385 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:23:01,386 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d3c535f901a63578debd9c638887d65, NAME => 'hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65.', STARTKEY => '', ENDKEY => ''} 2023-07-21 16:23:01,386 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. service=AccessControlService 2023-07-21 16:23:01,386 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 16:23:01,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. service=VisibilityLabelsService 2023-07-21 16:23:01,387 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-21 16:23:01,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:01,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:01,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:01,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:01,389 INFO [StoreOpener-0d3c535f901a63578debd9c638887d65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:01,392 DEBUG [StoreOpener-0d3c535f901a63578debd9c638887d65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/q 2023-07-21 16:23:01,392 DEBUG [StoreOpener-0d3c535f901a63578debd9c638887d65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/q 2023-07-21 16:23:01,392 INFO [StoreOpener-0d3c535f901a63578debd9c638887d65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d3c535f901a63578debd9c638887d65 columnFamilyName q 2023-07-21 16:23:01,393 INFO [StoreOpener-0d3c535f901a63578debd9c638887d65-1] regionserver.HStore(310): Store=0d3c535f901a63578debd9c638887d65/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:23:01,393 INFO [StoreOpener-0d3c535f901a63578debd9c638887d65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:01,395 DEBUG [StoreOpener-0d3c535f901a63578debd9c638887d65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/u 2023-07-21 16:23:01,395 DEBUG [StoreOpener-0d3c535f901a63578debd9c638887d65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/u 2023-07-21 16:23:01,396 INFO [StoreOpener-0d3c535f901a63578debd9c638887d65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d3c535f901a63578debd9c638887d65 columnFamilyName u 2023-07-21 16:23:01,397 INFO [StoreOpener-0d3c535f901a63578debd9c638887d65-1] regionserver.HStore(310): Store=0d3c535f901a63578debd9c638887d65/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:23:01,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:01,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:01,403 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-21 16:23:01,406 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d3c535f901a63578debd9c638887d65 2023-07-21 16:23:01,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 16:23:01,412 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d3c535f901a63578debd9c638887d65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10095204320, jitterRate=-0.059810832142829895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-21 16:23:01,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d3c535f901a63578debd9c638887d65: 2023-07-21 16:23:01,414 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65., pid=12, masterSystemTime=1689956581379 2023-07-21 16:23:01,417 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:23:01,417 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:23:01,418 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0d3c535f901a63578debd9c638887d65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:01,419 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689956581418"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689956581418"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689956581418"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689956581418"}]},"ts":"1689956581418"} 2023-07-21 16:23:01,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-07-21 16:23:01,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 0d3c535f901a63578debd9c638887d65, server=jenkins-hbase4.apache.org,45305,1689956577214 in 196 msec 2023-07-21 16:23:01,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=9 2023-07-21 16:23:01,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=0d3c535f901a63578debd9c638887d65, ASSIGN in 400 msec 2023-07-21 16:23:01,432 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 16:23:01,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956581432"}]},"ts":"1689956581432"} 2023-07-21 16:23:01,434 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2023-07-21 16:23:01,437 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 16:23:01,438 WARN [PEWorker-5] access.AccessController(784): Not adding owner permission for table hbase:quota. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-21 16:23:01,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 501 msec 2023-07-21 16:23:01,480 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-21 16:23:01,482 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => b52f322c34475d7a6cfe27a5411e4264, NAME => 'hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp 2023-07-21 16:23:01,497 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:01,497 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing b52f322c34475d7a6cfe27a5411e4264, disabling compactions & flushes 2023-07-21 16:23:01,498 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:23:01,498 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:23:01,498 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. after waiting 0 ms 2023-07-21 16:23:01,498 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:23:01,498 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:23:01,498 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for b52f322c34475d7a6cfe27a5411e4264: 2023-07-21 16:23:01,503 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 16:23:01,505 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689956581505"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689956581505"}]},"ts":"1689956581505"} 2023-07-21 16:23:01,508 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 16:23:01,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 16:23:01,510 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956581510"}]},"ts":"1689956581510"} 2023-07-21 16:23:01,513 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-21 16:23:01,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b52f322c34475d7a6cfe27a5411e4264, ASSIGN}] 2023-07-21 16:23:01,521 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b52f322c34475d7a6cfe27a5411e4264, ASSIGN 2023-07-21 16:23:01,523 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=b52f322c34475d7a6cfe27a5411e4264, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45305,1689956577214; forceNewPlan=false, retain=false 2023-07-21 16:23:01,675 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b52f322c34475d7a6cfe27a5411e4264, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:01,675 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689956581675"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689956581675"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689956581675"}]},"ts":"1689956581675"} 2023-07-21 16:23:01,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure b52f322c34475d7a6cfe27a5411e4264, server=jenkins-hbase4.apache.org,45305,1689956577214}] 2023-07-21 16:23:01,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-21 16:23:01,865 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:23:01,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b52f322c34475d7a6cfe27a5411e4264, NAME => 'hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264.', STARTKEY => '', ENDKEY => ''} 2023-07-21 16:23:01,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. service=AccessControlService 2023-07-21 16:23:01,866 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 16:23:01,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. service=VisibilityLabelsService 2023-07-21 16:23:01,867 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-21 16:23:01,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:01,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,870 INFO [StoreOpener-b52f322c34475d7a6cfe27a5411e4264-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,872 DEBUG [StoreOpener-b52f322c34475d7a6cfe27a5411e4264-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264/l 2023-07-21 16:23:01,872 DEBUG [StoreOpener-b52f322c34475d7a6cfe27a5411e4264-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264/l 2023-07-21 16:23:01,873 INFO [StoreOpener-b52f322c34475d7a6cfe27a5411e4264-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b52f322c34475d7a6cfe27a5411e4264 columnFamilyName l 2023-07-21 16:23:01,874 INFO [StoreOpener-b52f322c34475d7a6cfe27a5411e4264-1] regionserver.HStore(310): Store=b52f322c34475d7a6cfe27a5411e4264/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:23:01,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:23:01,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 16:23:01,890 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b52f322c34475d7a6cfe27a5411e4264; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10051580480, jitterRate=-0.06387361884117126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 16:23:01,891 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b52f322c34475d7a6cfe27a5411e4264: 2023-07-21 16:23:01,892 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264., pid=14, masterSystemTime=1689956581858 2023-07-21 16:23:01,894 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:23:01,895 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:23:01,895 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b52f322c34475d7a6cfe27a5411e4264, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:01,896 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689956581895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689956581895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689956581895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689956581895"}]},"ts":"1689956581895"} 2023-07-21 16:23:01,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-21 16:23:01,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure b52f322c34475d7a6cfe27a5411e4264, server=jenkins-hbase4.apache.org,45305,1689956577214 in 218 msec 2023-07-21 16:23:01,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-07-21 16:23:01,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=b52f322c34475d7a6cfe27a5411e4264, ASSIGN in 383 msec 2023-07-21 16:23:01,905 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 16:23:01,906 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956581905"}]},"ts":"1689956581905"} 2023-07-21 16:23:01,908 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-21 16:23:01,910 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 16:23:01,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=hbase:acl in 905 msec 2023-07-21 16:23:02,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-21 16:23:02,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 10 completed 2023-07-21 16:23:02,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 16:23:02,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:labels 2023-07-21 16:23:02,616 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 16:23:02,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "labels" procId is: 15 2023-07-21 16:23:02,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-21 16:23:02,617 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 16:23:02,620 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:02,621 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358 empty. 2023-07-21 16:23:02,621 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:02,621 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:labels regions 2023-07-21 16:23:02,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-21 16:23:03,042 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/hbase/labels/.tabledesc/.tableinfo.0000000001 2023-07-21 16:23:03,044 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6403f0a5b9af5b708b4a0cd74fa87358, NAME => 'hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp 2023-07-21 16:23:03,056 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(866): Instantiated hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:03,056 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1604): Closing 6403f0a5b9af5b708b4a0cd74fa87358, disabling compactions & flushes 2023-07-21 16:23:03,056 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1626): Closing region hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:23:03,056 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:23:03,056 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. after waiting 0 ms 2023-07-21 16:23:03,056 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:23:03,056 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1838): Closed hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:23:03,056 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1558): Region close journal for 6403f0a5b9af5b708b4a0cd74fa87358: 2023-07-21 16:23:03,060 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 16:23:03,061 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689956583061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689956583061"}]},"ts":"1689956583061"} 2023-07-21 16:23:03,064 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 16:23:03,065 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 16:23:03,065 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956583065"}]},"ts":"1689956583065"} 2023-07-21 16:23:03,067 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLING in hbase:meta 2023-07-21 16:23:03,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=6403f0a5b9af5b708b4a0cd74fa87358, ASSIGN}] 2023-07-21 16:23:03,073 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=6403f0a5b9af5b708b4a0cd74fa87358, ASSIGN 2023-07-21 16:23:03,075 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:labels, region=6403f0a5b9af5b708b4a0cd74fa87358, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45305,1689956577214; forceNewPlan=false, retain=false 2023-07-21 16:23:03,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6403f0a5b9af5b708b4a0cd74fa87358, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:03,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689956583226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689956583226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689956583226"}]},"ts":"1689956583226"} 2023-07-21 16:23:03,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 6403f0a5b9af5b708b4a0cd74fa87358, server=jenkins-hbase4.apache.org,45305,1689956577214}] 2023-07-21 16:23:03,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-21 16:23:03,388 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:23:03,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6403f0a5b9af5b708b4a0cd74fa87358, NAME => 'hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358.', STARTKEY => '', ENDKEY => ''} 2023-07-21 16:23:03,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. service=AccessControlService 2023-07-21 16:23:03,389 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 16:23:03,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. service=VisibilityLabelsService 2023-07-21 16:23:03,390 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-21 16:23:03,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table labels 6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:03,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:03,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:03,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:03,395 INFO [StoreOpener-6403f0a5b9af5b708b4a0cd74fa87358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:03,398 DEBUG [StoreOpener-6403f0a5b9af5b708b4a0cd74fa87358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358/f 2023-07-21 16:23:03,398 DEBUG [StoreOpener-6403f0a5b9af5b708b4a0cd74fa87358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358/f 2023-07-21 16:23:03,398 INFO [StoreOpener-6403f0a5b9af5b708b4a0cd74fa87358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6403f0a5b9af5b708b4a0cd74fa87358 columnFamilyName f 2023-07-21 16:23:03,399 INFO [StoreOpener-6403f0a5b9af5b708b4a0cd74fa87358-1] regionserver.HStore(310): Store=6403f0a5b9af5b708b4a0cd74fa87358/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:23:03,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:03,403 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:03,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:23:03,417 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 16:23:03,420 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6403f0a5b9af5b708b4a0cd74fa87358; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@483fc934, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 16:23:03,434 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2023-07-21 16:23:03,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6403f0a5b9af5b708b4a0cd74fa87358: 2023-07-21 16:23:03,439 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358., pid=17, masterSystemTime=1689956583382 2023-07-21 16:23:03,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(686): ZK sync() operation took 6ms 2023-07-21 16:23:03,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:23:03,444 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:23:03,445 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6403f0a5b9af5b708b4a0cd74fa87358, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:03,445 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689956583445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689956583445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689956583445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689956583445"}]},"ts":"1689956583445"} 2023-07-21 16:23:03,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-21 16:23:03,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 6403f0a5b9af5b708b4a0cd74fa87358, server=jenkins-hbase4.apache.org,45305,1689956577214 in 219 msec 2023-07-21 16:23:03,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-21 16:23:03,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=hbase:labels, region=6403f0a5b9af5b708b4a0cd74fa87358, ASSIGN in 380 msec 2023-07-21 16:23:03,457 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 16:23:03,457 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956583457"}]},"ts":"1689956583457"} 2023-07-21 16:23:03,460 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLED in hbase:meta 2023-07-21 16:23:03,470 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 16:23:03,476 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey hbase:labels jenkins.hfs.0: RWXCA 2023-07-21 16:23:03,502 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45305] access.PermissionStorage(611): Read acl: entry[hbase:labels], kv [jenkins.hfs.0: RWXCA] 2023-07-21 16:23:03,536 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 16:23:03,536 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:23:03,537 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 16:23:03,542 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/hbase:labels 2023-07-21 16:23:03,542 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-21 16:23:03,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-21 16:23:03,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; CreateTableProcedure table=hbase:labels in 933 msec 2023-07-21 16:23:04,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-21 16:23:04,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:labels, procId: 15 completed 2023-07-21 16:23:04,126 INFO [Listener at localhost/39229] hbase.ResourceChecker(147): before: client.TestQuotasShell#testRunShellTests Thread=237, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=175, AvailableMemoryMB=9206 2023-07-21 16:23:04,128 INFO [Listener at localhost/39229] client.AbstractTestShell(93): Starting ruby tests. includes: quotas_test.rb excludes: 2023-07-21 16:23:04,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds Ruby description: jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 25.362-b09 on 1.8.0_362-b09 +jit [linux-x86_64] 2023-07-21 16:23:04,705 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-21 16:23:04,798 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-21 16:23:04,800 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-21 16:23:04,801 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:labels' 2023-07-21 16:23:04,802 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-21 16:23:04,803 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag 2023-07-21 16:23:05,528 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:23:05,529 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-21 16:23:05,529 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:23:05,529 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase RegionObservers 2023-07-21 16:23:05,530 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:23:05,530 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-21 16:23:05,530 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:23:05,530 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-21 16:23:05,530 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 16:23:05,530 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-21 16:23:05,530 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-21 16:23:05,531 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2023-07-21 16:23:05,531 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 16:23:05,531 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-21 16:23:05,531 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:23:05,531 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase MasterObservers Running tests... Skip commands_test.rb because of not included Skip formatter_test.rb because of not included Skip converter_test.rb because of not included Skip list_locks_test.rb because of not included Skip list_procedures_test.rb because of not included Skip rsgroup_shell_test.rb because of not included Skip noninteractive_test.rb because of not included Skip shell_test.rb because of not included Skip table_test.rb because of not included Skip admin2_test.rb because of not included Skip hbase_test.rb because of not included Skip taskmonitor_test.rb because of not included Skip admin_test.rb because of not included Skip replication_admin_test.rb because of not included loading test file 'quotas_test.rb'. Skip security_admin_test.rb because of not included Skip visibility_labels_admin_test.rb because of not included Loaded suite src/test/ruby/tests_runner Started 2023-07-21 16:23:06,964 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x5a68e6bb to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:06,971 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a2f425, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:06,999 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:07,006 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:07,019 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:23:07,030 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-21 16:23:07,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 16:23:07,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase_shell_quota_tests_table 2023-07-21 16:23:07,043 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 16:23:07,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "hbase_shell_quota_tests_table" procId is: 18 2023-07-21 16:23:07,045 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 16:23:07,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-21 16:23:07,050 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,051 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e empty. 2023-07-21 16:23:07,052 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,052 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase_shell_quota_tests_table regions 2023-07-21 16:23:07,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-21 16:23:07,476 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp/data/default/hbase_shell_quota_tests_table/.tabledesc/.tableinfo.0000000001 2023-07-21 16:23:07,478 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(7675): creating {ENCODED => f9ae512c9ff91db9dfa624caa5704a6e, NAME => 'hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.tmp 2023-07-21 16:23:07,505 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:07,505 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1604): Closing f9ae512c9ff91db9dfa624caa5704a6e, disabling compactions & flushes 2023-07-21 16:23:07,505 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:07,505 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:07,505 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. after waiting 0 ms 2023-07-21 16:23:07,505 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:07,506 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:07,506 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1558): Region close journal for f9ae512c9ff91db9dfa624caa5704a6e: 2023-07-21 16:23:07,510 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 16:23:07,512 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689956587512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689956587512"}]},"ts":"1689956587512"} 2023-07-21 16:23:07,515 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 16:23:07,516 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 16:23:07,517 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956587516"}]},"ts":"1689956587516"} 2023-07-21 16:23:07,518 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLING in hbase:meta 2023-07-21 16:23:07,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=f9ae512c9ff91db9dfa624caa5704a6e, ASSIGN}] 2023-07-21 16:23:07,525 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=f9ae512c9ff91db9dfa624caa5704a6e, ASSIGN 2023-07-21 16:23:07,526 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=f9ae512c9ff91db9dfa624caa5704a6e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45305,1689956577214; forceNewPlan=false, retain=false 2023-07-21 16:23:07,677 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=f9ae512c9ff91db9dfa624caa5704a6e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:07,677 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689956587677"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689956587677"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689956587677"}]},"ts":"1689956587677"} 2023-07-21 16:23:07,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure f9ae512c9ff91db9dfa624caa5704a6e, server=jenkins-hbase4.apache.org,45305,1689956577214}] 2023-07-21 16:23:07,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-21 16:23:07,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:07,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9ae512c9ff91db9dfa624caa5704a6e, NAME => 'hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.', STARTKEY => '', ENDKEY => ''} 2023-07-21 16:23:07,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. service=AccessControlService 2023-07-21 16:23:07,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 16:23:07,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. service=VisibilityLabelsService 2023-07-21 16:23:07,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-21 16:23:07,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table hbase_shell_quota_tests_table f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 16:23:07,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,848 INFO [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family x of region f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,851 DEBUG [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x 2023-07-21 16:23:07,851 DEBUG [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x 2023-07-21 16:23:07,851 INFO [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9ae512c9ff91db9dfa624caa5704a6e columnFamilyName x 2023-07-21 16:23:07,852 INFO [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] regionserver.HStore(310): Store=f9ae512c9ff91db9dfa624caa5704a6e/x, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:23:07,853 INFO [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family y of region f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,855 DEBUG [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/y 2023-07-21 16:23:07,856 DEBUG [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/y 2023-07-21 16:23:07,856 INFO [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9ae512c9ff91db9dfa624caa5704a6e columnFamilyName y 2023-07-21 16:23:07,859 INFO [StoreOpener-f9ae512c9ff91db9dfa624caa5704a6e-1] regionserver.HStore(310): Store=f9ae512c9ff91db9dfa624caa5704a6e/y, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 16:23:07,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase_shell_quota_tests_table descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-21 16:23:07,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:23:07,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 16:23:07,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9ae512c9ff91db9dfa624caa5704a6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10941026720, jitterRate=0.018962517380714417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-21 16:23:07,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9ae512c9ff91db9dfa624caa5704a6e: 2023-07-21 16:23:07,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e., pid=20, masterSystemTime=1689956587836 2023-07-21 16:23:07,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:07,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:07,907 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=f9ae512c9ff91db9dfa624caa5704a6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:07,907 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689956587907"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689956587907"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689956587907"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689956587907"}]},"ts":"1689956587907"} 2023-07-21 16:23:07,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-21 16:23:07,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure f9ae512c9ff91db9dfa624caa5704a6e, server=jenkins-hbase4.apache.org,45305,1689956577214 in 233 msec 2023-07-21 16:23:07,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=18 2023-07-21 16:23:07,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=f9ae512c9ff91db9dfa624caa5704a6e, ASSIGN in 393 msec 2023-07-21 16:23:07,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 16:23:07,922 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689956587922"}]},"ts":"1689956587922"} 2023-07-21 16:23:07,924 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLED in hbase:meta 2023-07-21 16:23:07,929 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 16:23:07,929 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey hbase_shell_quota_tests_table jenkins: RWXCA 2023-07-21 16:23:07,931 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45305] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-21 16:23:07,933 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 16:23:07,933 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 16:23:07,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-21 16:23:07,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-21 16:23:07,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-21 16:23:07,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-21 16:23:07,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; CreateTableProcedure table=hbase_shell_quota_tests_table in 896 msec 2023-07-21 16:23:08,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-21 16:23:08,553 INFO [Listener at localhost/39229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:hbase_shell_quota_tests_table, procId: 18 completed Created table hbase_shell_quota_tests_table Took 1.5457 seconds Took 0.0432 seconds 2023-07-21 16:23:08,670 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x3bcdf2e3 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:08,686 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f12518c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:08,691 DEBUG [hconnection-0x57e6ca9d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:08,697 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:08,709 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bcdf2e3 to 127.0.0.1:62202 2023-07-21 16:23:08,710 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0062 seconds 2023-07-21 16:23:08,721 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x4a1073cf to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:08,736 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22465c38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:08,741 DEBUG [hconnection-0x616d63ab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:08,745 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:08,754 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a1073cf to 127.0.0.1:62202 2023-07-21 16:23:08,754 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0089 seconds 2023-07-21 16:23:08,766 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x24b425a4 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:08,784 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@da98be6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:08,788 DEBUG [hconnection-0x696f862b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:08,792 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:08,800 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24b425a4 to 127.0.0.1:62202 2023-07-21 16:23:08,800 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:08,803 INFO [Listener at localhost/39229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:23:08,803 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a68e6bb to 127.0.0.1:62202 2023-07-21 16:23:08,804 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:23:08,807 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x0008c87a to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:08,812 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eb7b602, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:08,911 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:08,915 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:08,928 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:23:08,931 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0141 seconds 2023-07-21 16:23:08,937 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x0722d337 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:08,944 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ef9319f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:08,947 DEBUG [hconnection-0x1047e53e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:08,949 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:08,955 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0722d337 to 127.0.0.1:62202 2023-07-21 16:23:08,956 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0077 seconds 2023-07-21 16:23:08,967 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x6ef585f8 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:08,975 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33dcf95f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:08,977 DEBUG [hconnection-0x4a4f7b56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:08,980 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:08,989 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ef585f8 to 127.0.0.1:62202 2023-07-21 16:23:08,990 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:08,993 INFO [Listener at localhost/39229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:23:08,993 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0008c87a to 127.0.0.1:62202 2023-07-21 16:23:08,993 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:23:08,995 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x37acc724 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,009 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@315c7945, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,096 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,100 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47774, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,106 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:23:09,117 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0191 seconds 2023-07-21 16:23:09,126 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x6ab1f959 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,132 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bf596cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,140 DEBUG [hconnection-0x693156a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,143 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,151 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ab1f959 to 127.0.0.1:62202 2023-07-21 16:23:09,152 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0070 seconds 2023-07-21 16:23:09,163 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x67dad376 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,178 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fd02757, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,187 DEBUG [hconnection-0x55e91713-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,199 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,206 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67dad376 to 127.0.0.1:62202 2023-07-21 16:23:09,207 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0057 seconds 2023-07-21 16:23:09,217 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x3ef6a06f to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,226 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ae2fe34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,312 DEBUG [hconnection-0x2343227e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,318 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,324 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ef6a06f to 127.0.0.1:62202 2023-07-21 16:23:09,324 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:09,326 INFO [Listener at localhost/39229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:23:09,326 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37acc724 to 127.0.0.1:62202 2023-07-21 16:23:09,326 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:23:09,328 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x06e0b1d7 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,333 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@377d6348, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,336 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,339 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,345 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:23:09,347 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0091 seconds 2023-07-21 16:23:09,355 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x0e877c91 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,361 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32c4a163, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,364 DEBUG [hconnection-0x7bb3475-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,369 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,377 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e877c91 to 127.0.0.1:62202 2023-07-21 16:23:09,378 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0084 seconds 2023-07-21 16:23:09,394 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x08629e75 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,423 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24b5a241, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,490 DEBUG [hconnection-0x5ef9b42-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,492 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,498 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08629e75 to 127.0.0.1:62202 2023-07-21 16:23:09,499 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:09,502 INFO [Listener at localhost/39229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:23:09,502 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06e0b1d7 to 127.0.0.1:62202 2023-07-21 16:23:09,502 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:23:09,505 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x16f810dd to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,513 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70c08a40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,516 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,518 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,524 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:23:09,526 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0102 seconds 2023-07-21 16:23:09,535 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x7701e928 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,543 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21a971ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,546 DEBUG [hconnection-0x554f6d12-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,549 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,563 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7701e928 to 127.0.0.1:62202 2023-07-21 16:23:09,564 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0082 seconds 2023-07-21 16:23:09,579 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x01d027f6 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,590 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13bcc51b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,601 DEBUG [hconnection-0x613ecb3f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,604 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,614 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01d027f6 to 127.0.0.1:62202 2023-07-21 16:23:09,615 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:09,617 INFO [Listener at localhost/39229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:23:09,618 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16f810dd to 127.0.0.1:62202 2023-07-21 16:23:09,618 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:23:09,622 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x074f3364 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:09,633 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49bdd232, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:09,637 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:09,639 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:09,645 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:23:09,649 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0101 seconds 2023-07-21 16:23:09,687 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:23:09,691 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService Took 0.0315 seconds Took 0.0033 seconds Took 0.0103 seconds Took 0.0027 seconds Took 0.0024 seconds Took 0.0022 seconds Took 0.0021 seconds Took 0.0025 seconds Took 0.0059 seconds Took 0.0029 seconds 2023-07-21 16:23:09,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-21 16:23:09,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-21 16:23:09,771 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-21 16:23:09,772 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-21 16:23:09,772 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-21 16:23:09,772 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-21 16:23:09,773 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:09,773 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:09,774 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-21 16:23:09,774 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:09,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-21 16:23:09,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 16:23:09,775 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:09,775 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 16:23:09,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:09,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:09,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-21 16:23:09,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:09,776 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-21 16:23:09,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-21 16:23:09,782 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-21 16:23:09,782 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-21 16:23:09,783 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-21 16:23:09,783 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-21 16:23:09,783 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:09,783 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-21 16:23:09,784 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. started... 2023-07-21 16:23:09,785 INFO [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f9ae512c9ff91db9dfa624caa5704a6e 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-21 16:23:10,283 INFO [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=14 (bloomFilter=true), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/.tmp/x/c3c91549fd79498686b522088f12204a 2023-07-21 16:23:10,347 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/.tmp/x/c3c91549fd79498686b522088f12204a as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/c3c91549fd79498686b522088f12204a 2023-07-21 16:23:10,358 INFO [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/c3c91549fd79498686b522088f12204a, entries=10, sequenceid=14, filesize=5.0 K 2023-07-21 16:23:10,366 INFO [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for f9ae512c9ff91db9dfa624caa5704a6e in 581ms, sequenceid=14, compaction requested=false 2023-07-21 16:23:10,367 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase_shell_quota_tests_table' 2023-07-21 16:23:10,369 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f9ae512c9ff91db9dfa624caa5704a6e: 2023-07-21 16:23:10,370 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-21 16:23:10,371 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-21 16:23:10,371 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,371 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-21 16:23:10,371 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45305,1689956577214' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-21 16:23:10,375 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,375 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-21 16:23:10,376 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:10,376 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 16:23:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:10,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45305,1689956577214' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-21 16:23:10,378 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-21 16:23:10,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14066f73[Count = 0] remaining members to acquire global barrier 2023-07-21 16:23:10,378 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:10,380 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:10,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:10,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:10,380 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-21 16:23:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-21 16:23:10,381 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,45305,1689956577214' in zk 2023-07-21 16:23:10,380 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 16:23:10,383 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-21 16:23:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 16:23:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-21 16:23:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-21 16:23:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,45305,1689956577214': 2023-07-21 16:23:10,388 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-21 16:23:10,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45305,1689956577214' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-21 16:23:10,388 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 16:23:10,388 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 16:23:10,388 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-21 16:23:10,388 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-21 16:23:10,391 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:10,391 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:10,392 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-21 16:23:10,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-21 16:23:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:10,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-21 16:23:10,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 16:23:10,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:10,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:10,394 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,396 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:10,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:10,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,411 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-21 16:23:10,411 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-21 16:23:10,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table because node does not exist (not an error) 2023-07-21 16:23:10,411 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 16:23:10,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 16:23:10,411 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:10,411 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-21 16:23:10,412 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:10,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-21 16:23:10,412 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-21 16:23:10,412 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:10,412 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:10,412 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:10,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-21 16:23:10,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 16:23:10,414 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-21 16:23:10,415 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-21 16:23:10,665 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-21 16:23:10,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.9353 seconds 2023-07-21 16:23:10,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-21 16:23:10,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689956590693 (current time:1689956590693). 2023-07-21 16:23:10,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 16:23:10,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ReadOnlyZKClient(139): Connect 0x2e2aed20 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:10,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d670d01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:10,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:10,704 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:10,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e2aed20 to 127.0.0.1:62202 2023-07-21 16:23:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:10,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ReadOnlyZKClient(139): Connect 0x506b46d4 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:10,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b6bb627, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:10,716 DEBUG [hconnection-0x682a8ccd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:10,718 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:10,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x506b46d4 to 127.0.0.1:62202 2023-07-21 16:23:10,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:10,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-21 16:23:10,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 16:23:10,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-21 16:23:10,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-21 16:23:10,772 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-21 16:23:10,773 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=21, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1689957190773 2023-07-21 16:23:10,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-21 16:23:10,774 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-21 16:23:10,776 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=21, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-21 16:23:10,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-21 16:23:10,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 12 msec 2023-07-21 16:23:10,778 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-21 16:23:10,779 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1689957190779 2023-07-21 16:23:10,781 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-21 16:23:10,782 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-21 16:23:10,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,800 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_1' 2023-07-21 16:23:10,800 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 16:23:10,800 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_1' starting 'acquire' 2023-07-21 16:23:10,801 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_1', kicking off acquire phase on members. 2023-07-21 16:23:10,801 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,801 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,803 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,803 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 16:23:10,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 16:23:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 16:23:10,803 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,803 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 16:23:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-21 16:23:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_1 from table hbase_shell_quota_tests_table type FLUSH 2023-07-21 16:23:10,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,809 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_1' with timeout 300000ms 2023-07-21 16:23:10,809 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 16:23:10,809 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_1' starting 'acquire' stage 2023-07-21 16:23:10,809 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_1' locally acquired 2023-07-21 16:23:10,809 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45305,1689956577214' joining acquired barrier for procedure (hbase_shell_quota_tests_table_1) in zk 2023-07-21 16:23:10,812 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,812 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:10,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 16:23:10,812 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,812 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 16:23:10,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:10,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45305,1689956577214' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_1' on coordinator 2023-07-21 16:23:10,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37089762[Count = 0] remaining members to acquire global barrier 2023-07-21 16:23:10,814 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_1' starting 'in-barrier' execution. 2023-07-21 16:23:10,814 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,816 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,816 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_1' received 'reached' from coordinator. 2023-07-21 16:23:10,816 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:10,817 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 16:23:10,818 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 16:23:10,818 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:10,818 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 16:23:10,818 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. started... 2023-07-21 16:23:10,818 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9ae512c9ff91db9dfa624caa5704a6e: 2023-07-21 16:23:10,820 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.' region-info for snapshot=hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,826 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 16:23:10,830 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/c3c91549fd79498686b522088f12204a] hfiles 2023-07-21 16:23:10,830 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/c3c91549fd79498686b522088f12204a for snapshot=hbase_shell_quota_tests_table_1 2023-07-21 16:23:10,833 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 16:23:11,032 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 16:23:11,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-21 16:23:11,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-21 16:23:11,038 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 16:23:11,249 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. completed. 2023-07-21 16:23:11,249 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:11,249 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 16:23:11,250 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 16:23:11,250 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,250 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_1' locally completed 2023-07-21 16:23:11,250 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_1' completed for member 'jenkins-hbase4.apache.org,45305,1689956577214' in zk 2023-07-21 16:23:11,253 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,253 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_1' has notified controller of completion 2023-07-21 16:23:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,254 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 16:23:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 16:23:11,254 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_1' completed. 2023-07-21 16:23:11,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:11,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_1' member 'jenkins-hbase4.apache.org,45305,1689956577214': 2023-07-21 16:23:11,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45305,1689956577214' released barrier for procedure'hbase_shell_quota_tests_table_1', counting down latch. Waiting for 0 more 2023-07-21 16:23:11,258 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_1' execution completed 2023-07-21 16:23:11,258 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 16:23:11,259 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 16:23:11,259 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,259 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 16:23:11,261 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,261 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 16:23:11,261 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 16:23:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:11,262 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 16:23:11,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 16:23:11,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,264 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:11,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,273 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 16:23:11,273 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 16:23:11,273 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 16:23:11,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 because node does not exist (not an error) 2023-07-21 16:23:11,273 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,273 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 16:23:11,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 16:23:11,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,274 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,274 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:11,274 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,274 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,274 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 16:23:11,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 16:23:11,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-21 16:23:11,539 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 16:23:11,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-21 16:23:11,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-21 16:23:11,541 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-21 16:23:11,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 to hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/hbase_shell_quota_tests_table_1 2023-07-21 16:23:12,291 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 16:23:12,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-21 16:23:12,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-21 16:23:12,293 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2428): (#4) Sleeping: 1250ms while waiting for snapshot completion. 2023-07-21 16:23:12,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed 2023-07-21 16:23:12,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-21 16:23:12,542 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-21 16:23:12,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1689956590774Consolidate snapshot: hbase_shell_quota_tests_table_1 at 1689956591274 (+500 ms)Loading Region manifests for hbase_shell_quota_tests_table_1 at 1689956591274Writing data manifest for hbase_shell_quota_tests_table_1 at 1689956591286 (+12 ms)Verifying snapshot: hbase_shell_quota_tests_table_1 at 1689956591701 (+415 ms)Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed at 1689956592541 (+840 ms) 2023-07-21 16:23:12,544 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-21 16:23:12,546 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 1.7680 sec 2023-07-21 16:23:13,348 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-21 16:23:13,544 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 16:23:13,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-21 16:23:13,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 2.8682 seconds Took 0.0027 seconds Took 0.0028 seconds Took 0.0020 seconds Took 0.0017 seconds Took 0.0017 seconds Took 0.0025 seconds Took 0.0019 seconds Took 0.0018 seconds Took 0.0018 seconds Took 0.0017 seconds 2023-07-21 16:23:13,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-21 16:23:13,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] procedure.ProcedureCoordinator(143): Procedure hbase_shell_quota_tests_table was in running list but was completed. Accepting new attempt. 2023-07-21 16:23:13,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-21 16:23:13,589 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-21 16:23:13,589 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-21 16:23:13,589 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-21 16:23:13,589 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-21 16:23:13,590 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:13,590 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:13,592 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-21 16:23:13,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-21 16:23:13,592 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:13,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 16:23:13,593 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:13,593 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 16:23:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:13,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-21 16:23:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:13,594 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-21 16:23:13,594 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc hbase_shell_quota_tests_table is still present, removing 2023-07-21 16:23:13,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-21 16:23:13,594 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-21 16:23:13,594 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-21 16:23:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-21 16:23:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-21 16:23:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-21 16:23:13,595 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:13,595 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. started... 2023-07-21 16:23:13,595 INFO [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f9ae512c9ff91db9dfa624caa5704a6e 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-21 16:23:14,016 INFO [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=28 (bloomFilter=true), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/.tmp/x/564b3f380ede459f94c71ac553552fcd 2023-07-21 16:23:14,027 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/.tmp/x/564b3f380ede459f94c71ac553552fcd as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/564b3f380ede459f94c71ac553552fcd 2023-07-21 16:23:14,036 INFO [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/564b3f380ede459f94c71ac553552fcd, entries=10, sequenceid=28, filesize=5.0 K 2023-07-21 16:23:14,038 INFO [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for f9ae512c9ff91db9dfa624caa5704a6e in 443ms, sequenceid=28, compaction requested=false 2023-07-21 16:23:14,038 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f9ae512c9ff91db9dfa624caa5704a6e: 2023-07-21 16:23:14,038 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:14,038 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-21 16:23:14,039 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-21 16:23:14,039 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,039 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-21 16:23:14,039 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45305,1689956577214' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-21 16:23:14,042 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,042 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-21 16:23:14,042 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:14,042 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 16:23:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:14,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45305,1689956577214' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-21 16:23:14,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7089d873[Count = 0] remaining members to acquire global barrier 2023-07-21 16:23:14,044 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-21 16:23:14,044 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:14,045 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:14,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:14,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:14,046 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-21 16:23:14,046 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-21 16:23:14,046 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,45305,1689956577214' in zk 2023-07-21 16:23:14,046 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,046 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 16:23:14,047 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,047 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-21 16:23:14,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,047 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 16:23:14,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:14,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-21 16:23:14,047 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-21 16:23:14,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:14,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:14,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:14,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:14,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:14,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,45305,1689956577214': 2023-07-21 16:23:14,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45305,1689956577214' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-21 16:23:14,052 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-21 16:23:14,052 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 16:23:14,052 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 16:23:14,052 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-21 16:23:14,052 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-21 16:23:14,054 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:14,055 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:14,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-21 16:23:14,055 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-21 16:23:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:14,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-21 16:23:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 16:23:14,055 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,057 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-21 16:23:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,059 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-21 16:23:14,060 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-21 16:23:14,060 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-21 16:23:14,060 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:14,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 16:23:14,060 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 16:23:14,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-21 16:23:14,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-21 16:23:14,060 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-21 16:23:14,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table because node does not exist (not an error) 2023-07-21 16:23:14,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-21 16:23:14,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 16:23:14,061 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-21 16:23:14,061 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,062 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-21 16:23:14,062 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:14,063 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-21 16:23:14,063 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-21 16:23:14,313 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-21 16:23:14,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.7362 seconds 2023-07-21 16:23:14,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-21 16:23:14,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689956594317 (current time:1689956594317). 2023-07-21 16:23:14,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 16:23:14,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ReadOnlyZKClient(139): Connect 0x61669486 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:14,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fad2751, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:14,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:14,327 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:14,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61669486 to 127.0.0.1:62202 2023-07-21 16:23:14,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:14,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ReadOnlyZKClient(139): Connect 0x209223cf to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:23:14,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@758551ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:23:14,342 DEBUG [hconnection-0x630467b1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:23:14,344 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:23:14,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x209223cf to 127.0.0.1:62202 2023-07-21 16:23:14,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:23:14,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-21 16:23:14,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 16:23:14,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-21 16:23:14,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-21 16:23:14,361 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-21 16:23:14,362 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=23, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1689957194362 2023-07-21 16:23:14,363 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-21 16:23:14,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-21 16:23:14,364 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-21 16:23:14,365 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-21 16:23:14,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-21 16:23:14,366 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=23, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-21 16:23:14,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 10 msec 2023-07-21 16:23:14,369 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-21 16:23:14,370 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=24, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1689957194370 2023-07-21 16:23:14,615 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 16:23:14,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-21 16:23:14,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-21 16:23:14,618 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 16:23:14,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,785 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_2' 2023-07-21 16:23:14,785 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 16:23:14,785 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_2' starting 'acquire' 2023-07-21 16:23:14,785 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_2', kicking off acquire phase on members. 2023-07-21 16:23:14,786 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,786 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,787 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 16:23:14,787 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 16:23:14,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 16:23:14,788 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,788 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 16:23:14,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-21 16:23:14,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,789 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_2 from table hbase_shell_quota_tests_table type FLUSH 2023-07-21 16:23:14,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,789 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_2' with timeout 300000ms 2023-07-21 16:23:14,789 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 16:23:14,790 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_2' starting 'acquire' stage 2023-07-21 16:23:14,790 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_2' locally acquired 2023-07-21 16:23:14,790 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45305,1689956577214' joining acquired barrier for procedure (hbase_shell_quota_tests_table_2) in zk 2023-07-21 16:23:14,791 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,791 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:14,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 16:23:14,792 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:14,792 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 16:23:14,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:14,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:14,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45305,1689956577214' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_2' on coordinator 2023-07-21 16:23:14,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aac2aab[Count = 0] remaining members to acquire global barrier 2023-07-21 16:23:14,793 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_2' starting 'in-barrier' execution. 2023-07-21 16:23:14,793 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,795 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,796 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_2' received 'reached' from coordinator. 2023-07-21 16:23:14,796 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:14,796 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 16:23:14,796 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 16:23:14,796 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 16:23:14,796 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:14,796 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. started... 2023-07-21 16:23:14,796 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9ae512c9ff91db9dfa624caa5704a6e: 2023-07-21 16:23:14,797 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.' region-info for snapshot=hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,797 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 16:23:14,797 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/c3c91549fd79498686b522088f12204a, hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/564b3f380ede459f94c71ac553552fcd] hfiles 2023-07-21 16:23:14,797 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/c3c91549fd79498686b522088f12204a for snapshot=hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,797 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/x/564b3f380ede459f94c71ac553552fcd for snapshot=hbase_shell_quota_tests_table_2 2023-07-21 16:23:14,797 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 16:23:15,118 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 16:23:15,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-21 16:23:15,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-21 16:23:15,122 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-21 16:23:15,207 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. completed. 2023-07-21 16:23:15,208 DEBUG [rs(jenkins-hbase4.apache.org,45305,1689956577214)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:23:15,208 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 16:23:15,208 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 16:23:15,208 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,208 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_2' locally completed 2023-07-21 16:23:15,208 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_2' completed for member 'jenkins-hbase4.apache.org,45305,1689956577214' in zk 2023-07-21 16:23:15,210 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_2' has notified controller of completion 2023-07-21 16:23:15,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:15,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 16:23:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 16:23:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_2' completed. 2023-07-21 16:23:15,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:15,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:15,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:15,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_2' member 'jenkins-hbase4.apache.org,45305,1689956577214': 2023-07-21 16:23:15,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45305,1689956577214' released barrier for procedure'hbase_shell_quota_tests_table_2', counting down latch. Waiting for 0 more 2023-07-21 16:23:15,214 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_2' execution completed 2023-07-21 16:23:15,214 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 16:23:15,214 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 16:23:15,214 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,214 INFO [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_2including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 16:23:15,216 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,216 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 16:23:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 16:23:15,216 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 16:23:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 16:23:15,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 16:23:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 16:23:15,216 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 16:23:15,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,218 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 16:23:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,220 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,221 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 16:23:15,221 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,221 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 16:23:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 16:23:15,221 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 16:23:15,221 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:23:15,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 because node does not exist (not an error) 2023-07-21 16:23:15,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,221 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 16:23:15,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 16:23:15,221 DEBUG [(jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 16:23:15,221 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,222 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 to hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/hbase_shell_quota_tests_table_2 2023-07-21 16:23:15,872 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 16:23:15,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-21 16:23:15,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-21 16:23:15,875 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2428): (#4) Sleeping: 1250ms while waiting for snapshot completion. 2023-07-21 16:23:16,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed 2023-07-21 16:23:16,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-21 16:23:16,474 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-21 16:23:16,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1689956594363Consolidate snapshot: hbase_shell_quota_tests_table_2 at 1689956595221 (+858 ms)Loading Region manifests for hbase_shell_quota_tests_table_2 at 1689956595222 (+1 ms)Writing data manifest for hbase_shell_quota_tests_table_2 at 1689956595226 (+4 ms)Verifying snapshot: hbase_shell_quota_tests_table_2 at 1689956595636 (+410 ms)Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed at 1689956596473 (+837 ms) 2023-07-21 16:23:16,475 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=24, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-21 16:23:16,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 2.1110 sec 2023-07-21 16:23:17,125 DEBUG [Listener at localhost/39229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 16:23:17,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-21 16:23:17,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 2.8125 seconds 2023-07-21 16:25:15,974 DEBUG [master/jenkins-hbase4:0.Chore.1] quotas.QuotaObserverChore(336): hbase_shell_quota_tests_table moved into observance of table space quota. 2023-07-21 16:27:57,234 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache(965): totalSize=587.81 KB, freeSize=781.83 MB, max=782.40 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2023-07-21 16:27:57,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): data stats (chunk size=2097152): current pool size=1, created chunk count=9, reused chunk count=1, reuseRatio=10.00% 2023-07-21 16:27:57,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2023-07-21 16:27:58,874 INFO [jenkins-hbase4:45305Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-21 16:27:59,393 DEBUG [master/jenkins-hbase4:0.Chore.1] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster. 2023-07-21 16:27:59,394 DEBUG [master/jenkins-hbase4:0.Chore.1] master.HMaster(1882): Balancer is going into sleep until next period in 300000ms 2023-07-21 16:27:59,400 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(200): Skipping table hbase_shell_quota_tests_table because normalization is disabled in its table properties and normalization is also disabled at table level by default 2023-07-21 16:27:59,406 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-21 16:28:00,926 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. because 5b3c00b56f24ee908925afac0f15a0d7/info has an old edit so flush to free WALs after random delay 33490 ms 2023-07-21 16:28:00,926 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because 1588230740/info has an old edit so flush to free WALs after random delay 140861 ms 2023-07-21 16:28:03,842 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. because b52f322c34475d7a6cfe27a5411e4264/l has an old edit so flush to free WALs after random delay 61980 ms 2023-07-21 16:28:03,842 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. because 6403f0a5b9af5b708b4a0cd74fa87358/f has an old edit so flush to free WALs after random delay 277365 ms 2023-07-21 16:28:04,710 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-21 16:28:08,867 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. because 0d3c535f901a63578debd9c638887d65/q has an old edit so flush to free WALs after random delay 61076 ms 2023-07-21 16:28:09,710 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:28:09,712 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2023-07-21 16:28:34,417 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 5b3c00b56f24ee908925afac0f15a0d7 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-21 16:28:34,432 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7/.tmp/info/99db6d2c87d14bb6af0f6bf7142adaad 2023-07-21 16:28:34,440 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7/.tmp/info/99db6d2c87d14bb6af0f6bf7142adaad as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7/info/99db6d2c87d14bb6af0f6bf7142adaad 2023-07-21 16:28:34,447 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7/info/99db6d2c87d14bb6af0f6bf7142adaad, entries=2, sequenceid=6, filesize=4.8 K 2023-07-21 16:28:34,448 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5b3c00b56f24ee908925afac0f15a0d7 in 31ms, sequenceid=6, compaction requested=false 2023-07-21 16:28:34,449 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 5b3c00b56f24ee908925afac0f15a0d7: 2023-07-21 16:29:02,263 DEBUG [master/jenkins-hbase4:0.Chore.1] zookeeper.ReadOnlyZKClient(139): Connect 0x17c9711d to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,268 DEBUG [master/jenkins-hbase4:0.Chore.1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e3602b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,270 DEBUG [hconnection-0x5a1790a3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,271 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:29:02,447 INFO [Listener at localhost/39229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:29:02,448 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x074f3364 to 127.0.0.1:62202 2023-07-21 16:29:02,448 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,452 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x35d4d041 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,457 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d3593d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,459 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,461 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:29:02,467 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35d4d041 to 127.0.0.1:62202 2023-07-21 16:29:02,467 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,472 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x3cc3acca to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,476 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2653f316, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,478 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,480 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:29:02,485 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cc3acca to 127.0.0.1:62202 2023-07-21 16:29:02,485 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,487 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x77c57974 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,491 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6788312f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,493 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,494 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:29:02,499 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77c57974 to 127.0.0.1:62202 2023-07-21 16:29:02,499 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,500 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x70655e43 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,507 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60e0318c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,509 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,510 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0106 seconds Took 0.0009 seconds Took 0.0008 seconds Took 0.0013 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0007 seconds Took 0.0007 seconds Took 0.0007 seconds Took 0.0007 seconds Took 0.0008 seconds 2023-07-21 16:29:02,550 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70655e43 to 127.0.0.1:62202 2023-07-21 16:29:02,551 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,552 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x2e8c5ec9 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,558 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a4b400c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,560 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,562 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0009 seconds 2023-07-21 16:29:02,570 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e8c5ec9 to 127.0.0.1:62202 2023-07-21 16:29:02,570 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,572 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x5dae0e6d to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,576 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@551d460c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,579 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,580 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0012 seconds 2023-07-21 16:29:02,587 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dae0e6d to 127.0.0.1:62202 2023-07-21 16:29:02,587 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,591 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x7a83cbda to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,601 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dbad7c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,603 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,605 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0013 seconds 2023-07-21 16:29:02,610 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a83cbda to 127.0.0.1:62202 2023-07-21 16:29:02,611 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,612 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x1ed0364c to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,616 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@181607ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,618 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,620 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:29:02,623 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:29:02,625 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0063 seconds 2023-07-21 16:29:02,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from false to true 2023-07-21 16:29:02,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from true to false Took 0.0030 seconds 2023-07-21 16:29:02,649 INFO [Listener at localhost/39229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:29:02,650 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ed0364c to 127.0.0.1:62202 2023-07-21 16:29:02,650 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:02,652 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x1529fca6 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:02,659 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d045f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:02,660 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:02,662 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 16:29:02,666 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 16:29:02,668 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-21 16:29:02,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] zookeeper.ZKUtil(398): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-21 16:29:02,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from true to false 2023-07-21 16:29:02,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] procedure2.ProcedureExecutor(1029): Stored pid=25, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,37367,1689956575349, rpcThrottleEnabled=false 2023-07-21 16:29:02,683 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:29:02,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,45305,1689956577214, rpcThrottleEnabled=false}] 2023-07-21 16:29:02,845 DEBUG [RSProcedureDispatcher-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 16:29:02,847 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 16:29:02,848 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45305] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=26 2023-07-21 16:29:02,849 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from true to false 2023-07-21 16:29:02,851 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=26 2023-07-21 16:29:02,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37367] master.HMaster(3641): Remote procedure done, pid=26 2023-07-21 16:29:02,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=25 2023-07-21 16:29:02,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=25, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,45305,1689956577214, rpcThrottleEnabled=false in 170 msec 2023-07-21 16:29:02,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,37367,1689956575349, rpcThrottleEnabled=false in 184 msec 2023-07-21 16:29:02,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from false to true 2023-07-21 16:29:02,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37367] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,37367,1689956575349, rpcThrottleEnabled=true 2023-07-21 16:29:02,866 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,45305,1689956577214, rpcThrottleEnabled=true}] 2023-07-21 16:29:03,019 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45305] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=28 2023-07-21 16:29:03,020 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from false to true 2023-07-21 16:29:03,020 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=28 2023-07-21 16:29:03,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37367] master.HMaster(3641): Remote procedure done, pid=28 2023-07-21 16:29:03,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-21 16:29:03,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,45305,1689956577214, rpcThrottleEnabled=true in 156 msec 2023-07-21 16:29:03,026 INFO [Listener at localhost/39229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:29:03,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,37367,1689956575349, rpcThrottleEnabled=true in 163 msec 2023-07-21 16:29:03,027 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1529fca6 to 127.0.0.1:62202 2023-07-21 16:29:03,027 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-21 16:29:03,029 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(139): Connect 0x792857e7 to 127.0.0.1:62202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 16:29:03,035 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d16c6cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-21 16:29:03,037 DEBUG [Listener at localhost/39229] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 16:29:03,039 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0011 seconds 2023-07-21 16:29:03,044 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x792857e7 to 127.0.0.1:62202 2023-07-21 16:29:03,044 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client . Finished in 356.09615 seconds. ------------------------------------------------------------------------------- 16 tests, 62 assertions, 0 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications 100% passed ------------------------------------------------------------------------------- 0.04 tests/s, 0.17 assertions/s Done with tests! Shutting down the cluster... 2023-07-21 16:29:03,066 INFO [Listener at localhost/39229] hbase.ResourceChecker(175): after: client.TestQuotasShell#testRunShellTests Thread=268 (was 237) Potentially hanging thread: RSProcedureDispatcher-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x792857e7 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/2122509283.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52d6c371-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x1529fca6 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/2122509283.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x1529fca6-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x1529fca6-SendThread(127.0.0.1:62202) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x17c9711d-SendThread(127.0.0.1:62202) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x52d6c371-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x5dae0e6d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x17c9711d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x2e8c5ec9-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52d6c371-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52d6c371-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x792857e7-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: region-location-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x7a83cbda-SendThread(127.0.0.1:62202) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: hconnection-0x5a1790a3-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1576965764_17 at /127.0.0.1:45142 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Ruby-0-JIT-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x17c9711d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/2122509283.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a1790a3-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x7a83cbda java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/2122509283.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jnr.ffi.util.ref.internal.Finalizer java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) jnr.ffi.util.ref.internal.Finalizer.run(Finalizer.java:180) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x5dae0e6d java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/2122509283.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45305,1689956577214' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x2e8c5ec9 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/2122509283.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x7a83cbda-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x5dae0e6d-SendThread(127.0.0.1:62202) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x2e8c5ec9-SendThread(127.0.0.1:62202) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62202@0x792857e7-SendThread(127.0.0.1:62202) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37367,1689956575349)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=493 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1 (was 122), ProcessCount=172 (was 175), AvailableMemoryMB=9652 (was 9206) - AvailableMemoryMB LEAK? - 2023-07-21 16:29:03,067 INFO [Listener at localhost/39229] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-21 16:29:03,068 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d91bf1c to 127.0.0.1:62202 2023-07-21 16:29:03,068 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:29:03,068 DEBUG [Listener at localhost/39229] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-21 16:29:03,068 DEBUG [Listener at localhost/39229] util.JVMClusterUtil(257): Found active master hash=1878361709, stopped=false 2023-07-21 16:29:03,068 DEBUG [Listener at localhost/39229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:29:03,069 DEBUG [Listener at localhost/39229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 16:29:03,069 DEBUG [Listener at localhost/39229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:29:03,069 DEBUG [Listener at localhost/39229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-21 16:29:03,069 INFO [Listener at localhost/39229] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:29:03,070 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 16:29:03,070 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 16:29:03,071 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:29:03,071 INFO [Listener at localhost/39229] procedure2.ProcedureExecutor(629): Stopping 2023-07-21 16:29:03,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 16:29:03,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 16:29:03,071 DEBUG [Listener at localhost/39229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62b33f68 to 127.0.0.1:62202 2023-07-21 16:29:03,071 DEBUG [Listener at localhost/39229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:29:03,072 INFO [Listener at localhost/39229] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45305,1689956577214' ***** 2023-07-21 16:29:03,072 DEBUG [Listener at localhost/39229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:29:03,072 INFO [Listener at localhost/39229] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 16:29:03,072 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-21 16:29:03,081 INFO [RS:0;jenkins-hbase4:45305] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@412c0e46{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-21 16:29:03,085 INFO [RS:0;jenkins-hbase4:45305] server.AbstractConnector(383): Stopped ServerConnector@697897c8{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-21 16:29:03,085 INFO [RS:0;jenkins-hbase4:45305] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-21 16:29:03,086 INFO [RS:0;jenkins-hbase4:45305] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2b99c003{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-21 16:29:03,086 INFO [RS:0;jenkins-hbase4:45305] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@6161fd4a{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/hadoop.log.dir/,STOPPED} 2023-07-21 16:29:03,088 INFO [RS:0;jenkins-hbase4:45305] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 16:29:03,088 INFO [RS:0;jenkins-hbase4:45305] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 16:29:03,088 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 16:29:03,088 INFO [RS:0;jenkins-hbase4:45305] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 16:29:03,089 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(3305): Received CLOSE for 5b3c00b56f24ee908925afac0f15a0d7 2023-07-21 16:29:03,089 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(3305): Received CLOSE for b52f322c34475d7a6cfe27a5411e4264 2023-07-21 16:29:03,089 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(3305): Received CLOSE for 0d3c535f901a63578debd9c638887d65 2023-07-21 16:29:03,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b3c00b56f24ee908925afac0f15a0d7, disabling compactions & flushes 2023-07-21 16:29:03,089 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(3305): Received CLOSE for 6403f0a5b9af5b708b4a0cd74fa87358 2023-07-21 16:29:03,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:29:03,090 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(3305): Received CLOSE for f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:29:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:29:03,090 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:29:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. after waiting 0 ms 2023-07-21 16:29:03,090 INFO [RS:0;jenkins-hbase4:45305] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 16:29:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:29:03,090 DEBUG [RS:0;jenkins-hbase4:45305] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x787a51cc to 127.0.0.1:62202 2023-07-21 16:29:03,090 DEBUG [RS:0;jenkins-hbase4:45305] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:29:03,090 INFO [RS:0;jenkins-hbase4:45305] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 16:29:03,090 INFO [RS:0;jenkins-hbase4:45305] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 16:29:03,090 INFO [RS:0;jenkins-hbase4:45305] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 16:29:03,090 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-21 16:29:03,091 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1474): Waiting on 6 regions to close 2023-07-21 16:29:03,091 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1478): Online Regions={5b3c00b56f24ee908925afac0f15a0d7=hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7., b52f322c34475d7a6cfe27a5411e4264=hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264., 0d3c535f901a63578debd9c638887d65=hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65., 1588230740=hbase:meta,,1.1588230740, 6403f0a5b9af5b708b4a0cd74fa87358=hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358., f9ae512c9ff91db9dfa624caa5704a6e=hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e.} 2023-07-21 16:29:03,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 16:29:03,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 16:29:03,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 16:29:03,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 16:29:03,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 16:29:03,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=6.34 KB heapSize=11.52 KB 2023-07-21 16:29:03,092 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1504): Waiting on 0d3c535f901a63578debd9c638887d65, 1588230740, 5b3c00b56f24ee908925afac0f15a0d7, 6403f0a5b9af5b708b4a0cd74fa87358, b52f322c34475d7a6cfe27a5411e4264, f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:29:03,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/namespace/5b3c00b56f24ee908925afac0f15a0d7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 16:29:03,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:29:03,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:29:03,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:29:03,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b3c00b56f24ee908925afac0f15a0d7: 2023-07-21 16:29:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689956579412.5b3c00b56f24ee908925afac0f15a0d7. 2023-07-21 16:29:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b52f322c34475d7a6cfe27a5411e4264, disabling compactions & flushes 2023-07-21 16:29:03,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:29:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:29:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. after waiting 0 ms 2023-07-21 16:29:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:29:03,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b52f322c34475d7a6cfe27a5411e4264 1/1 column families, dataSize=113 B heapSize=520 B 2023-07-21 16:29:03,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.88 KB at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/.tmp/info/5c76ff7ff531446ba7204335a6bae3a2 2023-07-21 16:29:03,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=113 B at sequenceid=6 (bloomFilter=false), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264/.tmp/l/9ce368516d7543b8a1bf6cada60b2bdf 2023-07-21 16:29:03,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264/.tmp/l/9ce368516d7543b8a1bf6cada60b2bdf as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264/l/9ce368516d7543b8a1bf6cada60b2bdf 2023-07-21 16:29:03,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=472 B at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/.tmp/table/abd61effd5fa4ff5b4d95973e434c050 2023-07-21 16:29:03,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264/l/9ce368516d7543b8a1bf6cada60b2bdf, entries=2, sequenceid=6, filesize=4.7 K 2023-07-21 16:29:03,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~113 B/113, heapSize ~504 B/504, currentSize=0 B/0 for b52f322c34475d7a6cfe27a5411e4264 in 40ms, sequenceid=6, compaction requested=false 2023-07-21 16:29:03,154 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/.tmp/info/5c76ff7ff531446ba7204335a6bae3a2 as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/info/5c76ff7ff531446ba7204335a6bae3a2 2023-07-21 16:29:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/acl/b52f322c34475d7a6cfe27a5411e4264/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 16:29:03,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:29:03,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:29:03,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:29:03,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b52f322c34475d7a6cfe27a5411e4264: 2023-07-21 16:29:03,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689956580994.b52f322c34475d7a6cfe27a5411e4264. 2023-07-21 16:29:03,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d3c535f901a63578debd9c638887d65, disabling compactions & flushes 2023-07-21 16:29:03,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:29:03,158 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 16:29:03,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:29:03,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. after waiting 0 ms 2023-07-21 16:29:03,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:29:03,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0d3c535f901a63578debd9c638887d65 2/2 column families, dataSize=1.31 KB heapSize=3.84 KB 2023-07-21 16:29:03,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/info/5c76ff7ff531446ba7204335a6bae3a2, entries=50, sequenceid=29, filesize=10.6 K 2023-07-21 16:29:03,163 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/.tmp/table/abd61effd5fa4ff5b4d95973e434c050 as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/table/abd61effd5fa4ff5b4d95973e434c050 2023-07-21 16:29:03,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/table/abd61effd5fa4ff5b4d95973e434c050, entries=10, sequenceid=29, filesize=5.1 K 2023-07-21 16:29:03,170 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~6.34 KB/6489, heapSize ~11.23 KB/11504, currentSize=0 B/0 for 1588230740 in 79ms, sequenceid=29, compaction requested=false 2023-07-21 16:29:03,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=830 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/.tmp/q/92bc24f7eac448418f99e6eb3d6053a6 2023-07-21 16:29:03,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/meta/1588230740/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-21 16:29:03,182 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:29:03,182 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 16:29:03,182 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:29:03,182 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 16:29:03,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 16:29:03,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-21 16:29:03,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92bc24f7eac448418f99e6eb3d6053a6 2023-07-21 16:29:03,292 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1504): Waiting on 0d3c535f901a63578debd9c638887d65, 6403f0a5b9af5b708b4a0cd74fa87358, f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:29:03,493 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1504): Waiting on 0d3c535f901a63578debd9c638887d65, 6403f0a5b9af5b708b4a0cd74fa87358, f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:29:03,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=510 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/.tmp/u/74f9dd81ae624a9e946526252a90eb44 2023-07-21 16:29:03,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74f9dd81ae624a9e946526252a90eb44 2023-07-21 16:29:03,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/.tmp/q/92bc24f7eac448418f99e6eb3d6053a6 as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/q/92bc24f7eac448418f99e6eb3d6053a6 2023-07-21 16:29:03,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92bc24f7eac448418f99e6eb3d6053a6 2023-07-21 16:29:03,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/q/92bc24f7eac448418f99e6eb3d6053a6, entries=8, sequenceid=24, filesize=5.2 K 2023-07-21 16:29:03,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/.tmp/u/74f9dd81ae624a9e946526252a90eb44 as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/u/74f9dd81ae624a9e946526252a90eb44 2023-07-21 16:29:03,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74f9dd81ae624a9e946526252a90eb44 2023-07-21 16:29:03,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/u/74f9dd81ae624a9e946526252a90eb44, entries=10, sequenceid=24, filesize=5.4 K 2023-07-21 16:29:03,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.31 KB/1340, heapSize ~3.80 KB/3896, currentSize=0 B/0 for 0d3c535f901a63578debd9c638887d65 in 458ms, sequenceid=24, compaction requested=false 2023-07-21 16:29:03,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/quota/0d3c535f901a63578debd9c638887d65/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-21 16:29:03,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:29:03,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:29:03,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:29:03,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d3c535f901a63578debd9c638887d65: 2023-07-21 16:29:03,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1689956580937.0d3c535f901a63578debd9c638887d65. 2023-07-21 16:29:03,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6403f0a5b9af5b708b4a0cd74fa87358, disabling compactions & flushes 2023-07-21 16:29:03,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:29:03,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:29:03,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. after waiting 0 ms 2023-07-21 16:29:03,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:29:03,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6403f0a5b9af5b708b4a0cd74fa87358 1/1 column families, dataSize=32 B heapSize=360 B 2023-07-21 16:29:03,693 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1504): Waiting on 6403f0a5b9af5b708b4a0cd74fa87358, f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:29:03,893 DEBUG [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1504): Waiting on 6403f0a5b9af5b708b4a0cd74fa87358, f9ae512c9ff91db9dfa624caa5704a6e 2023-07-21 16:29:03,926 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-21 16:29:03,926 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-21 16:29:04,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32 B at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358/.tmp/f/c5736b1f11c24f61a2361852e3d7e28f 2023-07-21 16:29:04,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358/.tmp/f/c5736b1f11c24f61a2361852e3d7e28f as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358/f/c5736b1f11c24f61a2361852e3d7e28f 2023-07-21 16:29:04,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358/f/c5736b1f11c24f61a2361852e3d7e28f, entries=1, sequenceid=4, filesize=4.6 K 2023-07-21 16:29:04,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32 B/32, heapSize ~344 B/344, currentSize=0 B/0 for 6403f0a5b9af5b708b4a0cd74fa87358 in 423ms, sequenceid=4, compaction requested=false 2023-07-21 16:29:04,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/hbase/labels/6403f0a5b9af5b708b4a0cd74fa87358/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=1 2023-07-21 16:29:04,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:29:04,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:29:04,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:29:04,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6403f0a5b9af5b708b4a0cd74fa87358: 2023-07-21 16:29:04,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:labels,,1689956582611.6403f0a5b9af5b708b4a0cd74fa87358. 2023-07-21 16:29:04,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9ae512c9ff91db9dfa624caa5704a6e, disabling compactions & flushes 2023-07-21 16:29:04,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:29:04,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:29:04,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. after waiting 0 ms 2023-07-21 16:29:04,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:29:04,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/data/default/hbase_shell_quota_tests_table/f9ae512c9ff91db9dfa624caa5704a6e/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-21 16:29:04,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 16:29:04,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-21 16:29:04,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:29:04,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9ae512c9ff91db9dfa624caa5704a6e: 2023-07-21 16:29:04,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase_shell_quota_tests_table,,1689956587038.f9ae512c9ff91db9dfa624caa5704a6e. 2023-07-21 16:29:04,093 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45305,1689956577214; all regions closed. 2023-07-21 16:29:04,093 DEBUG [RS:0;jenkins-hbase4:45305] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-21 16:29:04,105 DEBUG [RS:0;jenkins-hbase4:45305] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/oldWALs 2023-07-21 16:29:04,105 INFO [RS:0;jenkins-hbase4:45305] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45305%2C1689956577214.meta:.meta(num 1689956579119) 2023-07-21 16:29:04,110 DEBUG [RS:0;jenkins-hbase4:45305] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/oldWALs 2023-07-21 16:29:04,110 INFO [RS:0;jenkins-hbase4:45305] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45305%2C1689956577214:(num 1689956578995) 2023-07-21 16:29:04,110 DEBUG [RS:0;jenkins-hbase4:45305] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:29:04,110 INFO [RS:0;jenkins-hbase4:45305] regionserver.LeaseManager(133): Closed leases 2023-07-21 16:29:04,111 INFO [RS:0;jenkins-hbase4:45305] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 16:29:04,111 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 16:29:04,112 INFO [RS:0;jenkins-hbase4:45305] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45305 2023-07-21 16:29:04,119 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45305,1689956577214 2023-07-21 16:29:04,119 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 16:29:04,119 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 16:29:04,120 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45305,1689956577214] 2023-07-21 16:29:04,120 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45305,1689956577214; numProcessing=1 2023-07-21 16:29:04,123 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45305,1689956577214 already deleted, retry=false 2023-07-21 16:29:04,123 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45305,1689956577214 expired; onlineServers=0 2023-07-21 16:29:04,123 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37367,1689956575349' ***** 2023-07-21 16:29:04,123 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-21 16:29:04,124 DEBUG [M:0;jenkins-hbase4:37367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ec88c56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 16:29:04,124 INFO [M:0;jenkins-hbase4:37367] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-21 16:29:04,128 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-21 16:29:04,128 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 16:29:04,128 INFO [M:0;jenkins-hbase4:37367] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@9b5a588{master,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-21 16:29:04,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 16:29:04,129 INFO [M:0;jenkins-hbase4:37367] server.AbstractConnector(383): Stopped ServerConnector@64c7330a{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-21 16:29:04,129 INFO [M:0;jenkins-hbase4:37367] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-21 16:29:04,129 INFO [M:0;jenkins-hbase4:37367] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@6b98d438{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-21 16:29:04,130 INFO [M:0;jenkins-hbase4:37367] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@aeaf545{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/hadoop.log.dir/,STOPPED} 2023-07-21 16:29:04,130 INFO [M:0;jenkins-hbase4:37367] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37367,1689956575349 2023-07-21 16:29:04,130 INFO [M:0;jenkins-hbase4:37367] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37367,1689956575349; all regions closed. 2023-07-21 16:29:04,130 DEBUG [M:0;jenkins-hbase4:37367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 16:29:04,130 INFO [M:0;jenkins-hbase4:37367] master.HMaster(1491): Stopping master jetty server 2023-07-21 16:29:04,131 INFO [M:0;jenkins-hbase4:37367] server.AbstractConnector(383): Stopped ServerConnector@2fc2c814{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-21 16:29:04,131 DEBUG [M:0;jenkins-hbase4:37367] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-21 16:29:04,131 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-21 16:29:04,131 DEBUG [M:0;jenkins-hbase4:37367] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-21 16:29:04,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689956578660] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689956578660,5,FailOnTimeoutGroup] 2023-07-21 16:29:04,131 INFO [M:0;jenkins-hbase4:37367] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-21 16:29:04,131 INFO [M:0;jenkins-hbase4:37367] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-21 16:29:04,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689956578660] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689956578660,5,FailOnTimeoutGroup] 2023-07-21 16:29:04,132 INFO [M:0;jenkins-hbase4:37367] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 16:29:04,132 DEBUG [M:0;jenkins-hbase4:37367] master.HMaster(1512): Stopping service threads 2023-07-21 16:29:04,132 INFO [M:0;jenkins-hbase4:37367] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-21 16:29:04,133 INFO [M:0;jenkins-hbase4:37367] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-21 16:29:04,133 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-21 16:29:04,133 DEBUG [M:0;jenkins-hbase4:37367] zookeeper.ZKUtil(398): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-21 16:29:04,133 WARN [M:0;jenkins-hbase4:37367] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-21 16:29:04,133 INFO [M:0;jenkins-hbase4:37367] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-21 16:29:04,133 INFO [M:0;jenkins-hbase4:37367] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-21 16:29:04,134 DEBUG [M:0;jenkins-hbase4:37367] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 16:29:04,134 INFO [M:0;jenkins-hbase4:37367] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 16:29:04,134 DEBUG [M:0;jenkins-hbase4:37367] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 16:29:04,134 DEBUG [M:0;jenkins-hbase4:37367] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 16:29:04,134 DEBUG [M:0;jenkins-hbase4:37367] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 16:29:04,134 INFO [M:0;jenkins-hbase4:37367] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=95.74 KB heapSize=115.68 KB 2023-07-21 16:29:04,147 INFO [M:0;jenkins-hbase4:37367] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=95.74 KB at sequenceid=237 (bloomFilter=true), to=hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d02633be57e449e687d2b77a968db31e 2023-07-21 16:29:04,152 INFO [M:0;jenkins-hbase4:37367] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d02633be57e449e687d2b77a968db31e 2023-07-21 16:29:04,153 DEBUG [M:0;jenkins-hbase4:37367] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d02633be57e449e687d2b77a968db31e as hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d02633be57e449e687d2b77a968db31e 2023-07-21 16:29:04,159 INFO [M:0;jenkins-hbase4:37367] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d02633be57e449e687d2b77a968db31e 2023-07-21 16:29:04,160 INFO [M:0;jenkins-hbase4:37367] regionserver.HStore(1080): Added hdfs://localhost:42781/user/jenkins/test-data/a7de653d-1ee9-2741-a1fd-0a44220f10bb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d02633be57e449e687d2b77a968db31e, entries=28, sequenceid=237, filesize=7.7 K 2023-07-21 16:29:04,161 INFO [M:0;jenkins-hbase4:37367] regionserver.HRegion(2948): Finished flush of dataSize ~95.74 KB/98038, heapSize ~115.66 KB/118440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=237, compaction requested=false 2023-07-21 16:29:04,162 INFO [M:0;jenkins-hbase4:37367] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 16:29:04,162 DEBUG [M:0;jenkins-hbase4:37367] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 16:29:04,165 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 16:29:04,165 INFO [M:0;jenkins-hbase4:37367] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-21 16:29:04,165 INFO [M:0;jenkins-hbase4:37367] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37367 2023-07-21 16:29:04,167 DEBUG [M:0;jenkins-hbase4:37367] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37367,1689956575349 already deleted, retry=false 2023-07-21 16:29:04,223 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 16:29:04,223 INFO [RS:0;jenkins-hbase4:45305] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45305,1689956577214; zookeeper connection closed. 2023-07-21 16:29:04,223 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): regionserver:45305-0x10188b167cc0001, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 16:29:04,223 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@52804025] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@52804025 2023-07-21 16:29:04,224 INFO [Listener at localhost/39229] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-21 16:29:04,323 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 16:29:04,323 INFO [M:0;jenkins-hbase4:37367] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37367,1689956575349; zookeeper connection closed. 2023-07-21 16:29:04,323 DEBUG [Listener at localhost/39229-EventThread] zookeeper.ZKWatcher(600): master:37367-0x10188b167cc0000, quorum=127.0.0.1:62202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 16:29:04,325 WARN [Listener at localhost/39229] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 16:29:04,327 INFO [Listener at localhost/39229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 16:29:04,431 WARN [BP-535629964-172.31.14.131-1689956572303 heartbeating to localhost/127.0.0.1:42781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 16:29:04,431 WARN [BP-535629964-172.31.14.131-1689956572303 heartbeating to localhost/127.0.0.1:42781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-535629964-172.31.14.131-1689956572303 (Datanode Uuid 6e08a263-a035-4a6d-ad89-02dfa6f99aab) service to localhost/127.0.0.1:42781 2023-07-21 16:29:04,433 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/cluster_bb11de44-9ffb-d664-f1e8-4a0f6272fb5a/dfs/data/data1/current/BP-535629964-172.31.14.131-1689956572303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 16:29:04,433 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/d0bfbd20-906e-e813-5f45-519c8e3c963f/cluster_bb11de44-9ffb-d664-f1e8-4a0f6272fb5a/dfs/data/data2/current/BP-535629964-172.31.14.131-1689956572303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 16:29:04,467 INFO [Listener at localhost/39229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 16:29:04,577 INFO [Listener at localhost/39229] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-21 16:29:04,601 INFO [Listener at localhost/39229] hbase.HBaseTestingUtility(1293): Minicluster is down