2023-07-25 16:11:12,822 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1 2023-07-25 16:11:12,956 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestQuotasShell timeout: 13 mins 2023-07-25 16:11:13,086 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-25 16:11:13,195 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-25 16:11:13,196 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/cluster_6898d65f-5d8b-715b-1e6a-a8440fdb338e, deleteOnExit=true 2023-07-25 16:11:13,196 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-25 16:11:13,197 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/test.cache.data in system properties and HBase conf 2023-07-25 16:11:13,197 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/hadoop.tmp.dir in system properties and HBase conf 2023-07-25 16:11:13,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/hadoop.log.dir in system properties and HBase conf 2023-07-25 16:11:13,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-25 16:11:13,198 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-25 16:11:13,198 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-25 16:11:13,493 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-25 16:11:13,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-25 16:11:13,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-25 16:11:13,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-25 16:11:13,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-25 16:11:13,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-25 16:11:13,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-25 16:11:13,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-25 16:11:13,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-25 16:11:13,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-25 16:11:13,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/nfs.dump.dir in system properties and HBase conf 2023-07-25 16:11:13,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/java.io.tmpdir in system properties and HBase conf 2023-07-25 16:11:13,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-25 16:11:13,502 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-25 16:11:13,502 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-25 16:11:14,005 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-25 16:11:14,009 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-25 16:11:14,317 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-25 16:11:14,485 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-25 16:11:14,498 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-25 16:11:14,532 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-25 16:11:14,565 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/java.io.tmpdir/Jetty_localhost_45569_hdfs____.qqichr/webapp 2023-07-25 16:11:14,693 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45569 2023-07-25 16:11:14,712 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-25 16:11:14,712 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-25 16:11:15,211 WARN [Listener at localhost/33025] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-25 16:11:15,423 WARN [Listener at localhost/33025] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-25 16:11:15,439 WARN [Listener at localhost/33025] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-25 16:11:15,445 INFO [Listener at localhost/33025] log.Slf4jLog(67): jetty-6.1.26 2023-07-25 16:11:15,451 INFO [Listener at localhost/33025] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/java.io.tmpdir/Jetty_localhost_41695_datanode____.g93bl0/webapp 2023-07-25 16:11:15,557 INFO [Listener at localhost/33025] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41695 2023-07-25 16:11:15,791 WARN [Listener at localhost/35987] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-25 16:11:16,272 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5b041a1f6975c5de: Processing first storage report for DS-a259198f-a35c-460c-ab4e-373f1f9c206d from datanode dba5feea-b226-4375-8907-17c1b166309f 2023-07-25 16:11:16,274 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5b041a1f6975c5de: from storage DS-a259198f-a35c-460c-ab4e-373f1f9c206d node DatanodeRegistration(127.0.0.1:46803, datanodeUuid=dba5feea-b226-4375-8907-17c1b166309f, infoPort=39705, infoSecurePort=0, ipcPort=35987, storageInfo=lv=-57;cid=testClusterID;nsid=1147608808;c=1690301474081), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-25 16:11:16,274 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5b041a1f6975c5de: Processing first storage report for DS-2537cc77-4911-4e32-8cb6-88abb4164a03 from datanode dba5feea-b226-4375-8907-17c1b166309f 2023-07-25 16:11:16,274 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5b041a1f6975c5de: from storage DS-2537cc77-4911-4e32-8cb6-88abb4164a03 node DatanodeRegistration(127.0.0.1:46803, datanodeUuid=dba5feea-b226-4375-8907-17c1b166309f, infoPort=39705, infoSecurePort=0, ipcPort=35987, storageInfo=lv=-57;cid=testClusterID;nsid=1147608808;c=1690301474081), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-25 16:11:16,339 DEBUG [Listener at localhost/35987] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1 2023-07-25 16:11:16,413 INFO [Listener at localhost/35987] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/cluster_6898d65f-5d8b-715b-1e6a-a8440fdb338e/zookeeper_0, clientPort=62218, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/cluster_6898d65f-5d8b-715b-1e6a-a8440fdb338e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/cluster_6898d65f-5d8b-715b-1e6a-a8440fdb338e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-25 16:11:16,430 INFO [Listener at localhost/35987] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62218 2023-07-25 16:11:16,440 INFO [Listener at localhost/35987] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-25 16:11:16,442 INFO [Listener at localhost/35987] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-25 16:11:17,127 INFO [Listener at localhost/35987] util.FSUtils(471): Created version file at hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00 with version=8 2023-07-25 16:11:17,127 INFO [Listener at localhost/35987] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/hbase-staging 2023-07-25 16:11:17,149 DEBUG [Listener at localhost/35987] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-25 16:11:17,149 DEBUG [Listener at localhost/35987] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-25 16:11:17,554 INFO [Listener at localhost/35987] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-25 16:11:18,114 INFO [Listener at localhost/35987] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=18 2023-07-25 16:11:18,147 INFO [Listener at localhost/35987] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-25 16:11:18,148 INFO [Listener at localhost/35987] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-25 16:11:18,148 INFO [Listener at localhost/35987] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-25 16:11:18,148 INFO [Listener at localhost/35987] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-25 16:11:18,148 INFO [Listener at localhost/35987] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-25 16:11:18,300 INFO [Listener at localhost/35987] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-25 16:11:18,374 DEBUG [Listener at localhost/35987] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-25 16:11:18,478 INFO [Listener at localhost/35987] ipc.NettyRpcServer(120): Bind to /172.31.2.20:35973 2023-07-25 16:11:18,492 INFO [Listener at localhost/35987] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-25 16:11:18,494 INFO [Listener at localhost/35987] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-25 16:11:18,518 INFO [Listener at localhost/35987] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35973 connecting to ZooKeeper ensemble=127.0.0.1:62218 2023-07-25 16:11:18,561 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:359730x0, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-25 16:11:18,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35973-0x100c4cbab1b0000 connected 2023-07-25 16:11:18,635 DEBUG [Listener at localhost/35987] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-25 16:11:18,636 DEBUG [Listener at localhost/35987] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-25 16:11:18,655 DEBUG [Listener at localhost/35987] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-25 16:11:18,667 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35973 2023-07-25 16:11:18,668 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35973 2023-07-25 16:11:18,669 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35973 2023-07-25 16:11:18,674 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35973 2023-07-25 16:11:18,675 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35973 2023-07-25 16:11:18,717 INFO [Listener at localhost/35987] log.Log(170): Logging initialized @6542ms to org.apache.hbase.thirdparty.org.eclipse.jetty.util.log.Slf4jLog 2023-07-25 16:11:18,893 INFO [Listener at localhost/35987] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-25 16:11:18,894 INFO [Listener at localhost/35987] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-25 16:11:18,894 INFO [Listener at localhost/35987] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-25 16:11:18,896 INFO [Listener at localhost/35987] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-25 16:11:18,897 INFO [Listener at localhost/35987] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-25 16:11:18,897 INFO [Listener at localhost/35987] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-25 16:11:18,901 INFO [Listener at localhost/35987] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-25 16:11:18,969 INFO [Listener at localhost/35987] http.HttpServer(1146): Jetty bound to port 41021 2023-07-25 16:11:18,972 INFO [Listener at localhost/35987] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-25 16:11:19,002 INFO [Listener at localhost/35987] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-25 16:11:19,005 INFO [Listener at localhost/35987] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@32a929fb{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/hadoop.log.dir/,AVAILABLE} 2023-07-25 16:11:19,006 INFO [Listener at localhost/35987] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-25 16:11:19,006 INFO [Listener at localhost/35987] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@526153ee{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-25 16:11:19,200 INFO [Listener at localhost/35987] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-25 16:11:19,212 INFO [Listener at localhost/35987] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-25 16:11:19,212 INFO [Listener at localhost/35987] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-25 16:11:19,214 INFO [Listener at localhost/35987] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-25 16:11:19,221 INFO [Listener at localhost/35987] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-25 16:11:19,254 INFO [Listener at localhost/35987] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@7b2b3236{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/java.io.tmpdir/jetty-0_0_0_0-41021-hbase-server-2_4_18-SNAPSHOT_jar-_-any-8104665458180792636/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-25 16:11:19,269 INFO [Listener at localhost/35987] server.AbstractConnector(333): Started ServerConnector@3c41a27b{HTTP/1.1, (http/1.1)}{0.0.0.0:41021} 2023-07-25 16:11:19,269 INFO [Listener at localhost/35987] server.Server(415): Started @7095ms 2023-07-25 16:11:19,274 INFO [Listener at localhost/35987] master.HMaster(444): hbase.rootdir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00, hbase.cluster.distributed=false 2023-07-25 16:11:19,339 INFO [Listener at localhost/35987] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=18 2023-07-25 16:11:19,339 INFO [Listener at localhost/35987] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-25 16:11:19,339 INFO [Listener at localhost/35987] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-25 16:11:19,339 INFO [Listener at localhost/35987] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-25 16:11:19,339 INFO [Listener at localhost/35987] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-25 16:11:19,339 INFO [Listener at localhost/35987] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-25 16:11:19,344 INFO [Listener at localhost/35987] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-25 16:11:19,347 INFO [Listener at localhost/35987] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44091 2023-07-25 16:11:19,350 INFO [Listener at localhost/35987] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-25 16:11:19,357 DEBUG [Listener at localhost/35987] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-25 16:11:19,358 INFO [Listener at localhost/35987] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-25 16:11:19,362 INFO [Listener at localhost/35987] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-25 16:11:19,364 INFO [Listener at localhost/35987] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44091 connecting to ZooKeeper ensemble=127.0.0.1:62218 2023-07-25 16:11:19,367 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:440910x0, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-25 16:11:19,369 DEBUG [Listener at localhost/35987] zookeeper.ZKUtil(164): regionserver:440910x0, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-25 16:11:19,372 DEBUG [Listener at localhost/35987] zookeeper.ZKUtil(164): regionserver:440910x0, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-25 16:11:19,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44091-0x100c4cbab1b0001 connected 2023-07-25 16:11:19,377 DEBUG [Listener at localhost/35987] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-25 16:11:19,378 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44091 2023-07-25 16:11:19,379 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44091 2023-07-25 16:11:19,379 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44091 2023-07-25 16:11:19,383 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44091 2023-07-25 16:11:19,384 DEBUG [Listener at localhost/35987] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44091 2023-07-25 16:11:19,386 INFO [Listener at localhost/35987] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-25 16:11:19,386 INFO [Listener at localhost/35987] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-25 16:11:19,386 INFO [Listener at localhost/35987] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-25 16:11:19,387 INFO [Listener at localhost/35987] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-25 16:11:19,387 INFO [Listener at localhost/35987] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-25 16:11:19,387 INFO [Listener at localhost/35987] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-25 16:11:19,388 INFO [Listener at localhost/35987] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-25 16:11:19,389 INFO [Listener at localhost/35987] http.HttpServer(1146): Jetty bound to port 43585 2023-07-25 16:11:19,390 INFO [Listener at localhost/35987] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-25 16:11:19,393 INFO [Listener at localhost/35987] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-25 16:11:19,394 INFO [Listener at localhost/35987] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@41f33dc0{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/hadoop.log.dir/,AVAILABLE} 2023-07-25 16:11:19,394 INFO [Listener at localhost/35987] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-25 16:11:19,394 INFO [Listener at localhost/35987] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@5ea7b6c3{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-25 16:11:19,527 INFO [Listener at localhost/35987] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-25 16:11:19,528 INFO [Listener at localhost/35987] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-25 16:11:19,528 INFO [Listener at localhost/35987] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-25 16:11:19,529 INFO [Listener at localhost/35987] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-25 16:11:19,530 INFO [Listener at localhost/35987] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-25 16:11:19,534 INFO [Listener at localhost/35987] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@72f28dfc{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/java.io.tmpdir/jetty-0_0_0_0-43585-hbase-server-2_4_18-SNAPSHOT_jar-_-any-6704351122982298408/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-25 16:11:19,535 INFO [Listener at localhost/35987] server.AbstractConnector(333): Started ServerConnector@21a16fa5{HTTP/1.1, (http/1.1)}{0.0.0.0:43585} 2023-07-25 16:11:19,536 INFO [Listener at localhost/35987] server.Server(415): Started @7361ms 2023-07-25 16:11:19,542 INFO [master/jenkins-hbase6:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-25 16:11:19,546 INFO [master/jenkins-hbase6:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@c58d32d{HTTP/1.1, (http/1.1)}{0.0.0.0:39335} 2023-07-25 16:11:19,546 INFO [master/jenkins-hbase6:0:becomeActiveMaster] server.Server(415): Started @7372ms 2023-07-25 16:11:19,546 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:11:19,556 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-25 16:11:19,558 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:11:19,579 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-25 16:11:19,579 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-25 16:11:19,579 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:19,580 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-25 16:11:19,582 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,35973,1690301477364 from backup master directory 2023-07-25 16:11:19,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-25 16:11:19,589 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:11:19,589 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-25 16:11:19,590 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-25 16:11:19,590 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:11:19,595 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-25 16:11:19,596 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-25 16:11:19,692 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/hbase.id with ID: 68aa0c36-d385-4140-86cb-11dcbb0820a3 2023-07-25 16:11:19,738 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-25 16:11:19,763 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:19,808 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x79000ed5 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:19,835 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff0de7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:19,859 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-25 16:11:19,861 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-25 16:11:19,883 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-25 16:11:19,883 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-25 16:11:19,885 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-25 16:11:19,889 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-25 16:11:19,891 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-25 16:11:19,942 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store-tmp 2023-07-25 16:11:19,974 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:19,975 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-25 16:11:19,975 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-25 16:11:19,975 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-25 16:11:19,975 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-25 16:11:19,975 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-25 16:11:19,975 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-25 16:11:19,976 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-25 16:11:19,977 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/WALs/jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:11:20,008 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C35973%2C1690301477364, suffix=, logDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/WALs/jenkins-hbase6.apache.org,35973,1690301477364, archiveDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/oldWALs, maxLogs=10 2023-07-25 16:11:20,065 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46803,DS-a259198f-a35c-460c-ab4e-373f1f9c206d,DISK] 2023-07-25 16:11:20,075 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-25 16:11:20,149 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/WALs/jenkins-hbase6.apache.org,35973,1690301477364/jenkins-hbase6.apache.org%2C35973%2C1690301477364.1690301480020 2023-07-25 16:11:20,149 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46803,DS-a259198f-a35c-460c-ab4e-373f1f9c206d,DISK]] 2023-07-25 16:11:20,150 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-25 16:11:20,151 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:20,155 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-25 16:11:20,157 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-25 16:11:20,236 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-25 16:11:20,244 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-25 16:11:20,281 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-25 16:11:20,293 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:20,299 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-25 16:11:20,301 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-25 16:11:20,317 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-25 16:11:20,321 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-25 16:11:20,322 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10832647520, jitterRate=0.00886891782283783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-25 16:11:20,322 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-25 16:11:20,324 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-25 16:11:20,346 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-25 16:11:20,346 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-25 16:11:20,349 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-25 16:11:20,350 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-25 16:11:20,388 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 37 msec 2023-07-25 16:11:20,388 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-25 16:11:20,422 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-25 16:11:20,428 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-25 16:11:20,453 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-25 16:11:20,458 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-25 16:11:20,459 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-25 16:11:20,465 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-25 16:11:20,469 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-25 16:11:20,472 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:20,474 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-25 16:11:20,475 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-25 16:11:20,488 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-25 16:11:20,492 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-25 16:11:20,492 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-25 16:11:20,493 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:20,493 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase6.apache.org,35973,1690301477364, sessionid=0x100c4cbab1b0000, setting cluster-up flag (Was=false) 2023-07-25 16:11:20,509 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:20,519 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-25 16:11:20,520 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:11:20,526 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:20,531 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-25 16:11:20,532 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:11:20,534 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp 2023-07-25 16:11:20,540 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(951): ClusterId : 68aa0c36-d385-4140-86cb-11dcbb0820a3 2023-07-25 16:11:20,546 DEBUG [RS:0;jenkins-hbase6:44091] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-25 16:11:20,553 DEBUG [RS:0;jenkins-hbase6:44091] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-25 16:11:20,553 DEBUG [RS:0;jenkins-hbase6:44091] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-25 16:11:20,556 DEBUG [RS:0;jenkins-hbase6:44091] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-25 16:11:20,556 DEBUG [RS:0;jenkins-hbase6:44091] zookeeper.ReadOnlyZKClient(139): Connect 0x12782a75 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:20,562 DEBUG [RS:0;jenkins-hbase6:44091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d78ac9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:20,563 DEBUG [RS:0;jenkins-hbase6:44091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26950bb3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-07-25 16:11:20,594 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:44091 2023-07-25 16:11:20,600 INFO [RS:0;jenkins-hbase6:44091] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-25 16:11:20,600 INFO [RS:0;jenkins-hbase6:44091] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-25 16:11:20,626 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-25 16:11:20,626 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-25 16:11:20,628 INFO [master/jenkins-hbase6:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-25 16:11:20,628 INFO [RS:0;jenkins-hbase6:44091] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-25 16:11:20,629 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1022): About to register with Master. 2023-07-25 16:11:20,629 INFO [master/jenkins-hbase6:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-25 16:11:20,632 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,35973,1690301477364 with isa=jenkins-hbase6.apache.org/172.31.2.20:44091, startcode=1690301479338 2023-07-25 16:11:20,634 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=VisibilityLabelsService 2023-07-25 16:11:20,635 INFO [master/jenkins-hbase6:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870913. 2023-07-25 16:11:20,635 INFO [master/jenkins-hbase6:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870914. 2023-07-25 16:11:20,650 DEBUG [RS:0;jenkins-hbase6:44091] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-25 16:11:20,706 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53111, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-25 16:11:20,715 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35973] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-25 16:11:20,723 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-25 16:11:20,735 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-07-25 16:11:20,735 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-07-25 16:11:20,735 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-07-25 16:11:20,735 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-07-25 16:11:20,735 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-07-25 16:11:20,736 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,736 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-07-25 16:11:20,736 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,746 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(2830): Master is not running yet 2023-07-25 16:11:20,746 WARN [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-25 16:11:20,747 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690301510747 2023-07-25 16:11:20,749 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-25 16:11:20,753 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-25 16:11:20,757 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-25 16:11:20,759 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-25 16:11:20,762 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-25 16:11:20,762 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-25 16:11:20,763 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-25 16:11:20,763 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-25 16:11:20,764 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,765 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-25 16:11:20,766 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-25 16:11:20,768 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-25 16:11:20,768 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-25 16:11:20,775 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-25 16:11:20,776 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-25 16:11:20,779 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1690301480778,5,FailOnTimeoutGroup] 2023-07-25 16:11:20,780 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1690301480779,5,FailOnTimeoutGroup] 2023-07-25 16:11:20,780 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,781 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-25 16:11:20,783 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,783 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,847 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,35973,1690301477364 with isa=jenkins-hbase6.apache.org/172.31.2.20:44091, startcode=1690301479338 2023-07-25 16:11:20,852 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35973] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:20,858 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00 2023-07-25 16:11:20,858 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33025 2023-07-25 16:11:20,858 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=41021 2023-07-25 16:11:20,883 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-25 16:11:20,884 DEBUG [RS:0;jenkins-hbase6:44091] zookeeper.ZKUtil(162): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:20,884 WARN [RS:0;jenkins-hbase6:44091] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-25 16:11:20,885 INFO [RS:0;jenkins-hbase6:44091] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-25 16:11:20,885 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/WALs/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:20,885 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44091,1690301479338] 2023-07-25 16:11:20,896 DEBUG [RS:0;jenkins-hbase6:44091] zookeeper.ZKUtil(162): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:20,911 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-25 16:11:20,922 INFO [RS:0;jenkins-hbase6:44091] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-25 16:11:20,948 INFO [RS:0;jenkins-hbase6:44091] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-25 16:11:20,954 INFO [RS:0;jenkins-hbase6:44091] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-25 16:11:20,954 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,955 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-25 16:11:20,964 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,964 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,965 DEBUG [RS:0;jenkins-hbase6:44091] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-25 16:11:20,966 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,966 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,966 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,966 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:20,984 INFO [RS:0;jenkins-hbase6:44091] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-25 16:11:20,987 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44091,1690301479338-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:21,004 INFO [RS:0;jenkins-hbase6:44091] regionserver.Replication(203): jenkins-hbase6.apache.org,44091,1690301479338 started 2023-07-25 16:11:21,005 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1637): Serving as jenkins-hbase6.apache.org,44091,1690301479338, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44091, sessionid=0x100c4cbab1b0001 2023-07-25 16:11:21,005 DEBUG [RS:0;jenkins-hbase6:44091] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-25 16:11:21,005 DEBUG [RS:0;jenkins-hbase6:44091] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:21,005 DEBUG [RS:0;jenkins-hbase6:44091] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44091,1690301479338' 2023-07-25 16:11:21,005 DEBUG [RS:0;jenkins-hbase6:44091] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-25 16:11:21,006 DEBUG [RS:0;jenkins-hbase6:44091] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-25 16:11:21,006 DEBUG [RS:0;jenkins-hbase6:44091] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-25 16:11:21,006 DEBUG [RS:0;jenkins-hbase6:44091] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-25 16:11:21,006 DEBUG [RS:0;jenkins-hbase6:44091] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:21,006 DEBUG [RS:0;jenkins-hbase6:44091] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44091,1690301479338' 2023-07-25 16:11:21,006 DEBUG [RS:0;jenkins-hbase6:44091] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-25 16:11:21,007 DEBUG [RS:0;jenkins-hbase6:44091] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-25 16:11:21,007 DEBUG [RS:0;jenkins-hbase6:44091] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-25 16:11:21,008 INFO [RS:0;jenkins-hbase6:44091] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-25 16:11:21,009 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:21,010 DEBUG [RS:0;jenkins-hbase6:44091] zookeeper.ZKUtil(398): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-25 16:11:21,010 INFO [RS:0;jenkins-hbase6:44091] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-25 16:11:21,011 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:21,011 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:21,123 INFO [RS:0;jenkins-hbase6:44091] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44091%2C1690301479338, suffix=, logDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/WALs/jenkins-hbase6.apache.org,44091,1690301479338, archiveDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/oldWALs, maxLogs=32 2023-07-25 16:11:21,143 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46803,DS-a259198f-a35c-460c-ab4e-373f1f9c206d,DISK] 2023-07-25 16:11:21,147 INFO [RS:0;jenkins-hbase6:44091] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/WALs/jenkins-hbase6.apache.org,44091,1690301479338/jenkins-hbase6.apache.org%2C44091%2C1690301479338.1690301481125 2023-07-25 16:11:21,147 DEBUG [RS:0;jenkins-hbase6:44091] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46803,DS-a259198f-a35c-460c-ab4e-373f1f9c206d,DISK]] 2023-07-25 16:11:21,195 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-25 16:11:21,197 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-25 16:11:21,197 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00 2023-07-25 16:11:21,611 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:21,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-25 16:11:21,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/info 2023-07-25 16:11:21,617 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-25 16:11:21,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:21,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-25 16:11:21,622 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/rep_barrier 2023-07-25 16:11:21,623 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-25 16:11:21,624 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:21,624 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-25 16:11:21,627 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/table 2023-07-25 16:11:21,627 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-25 16:11:21,628 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:21,630 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740 2023-07-25 16:11:21,631 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740 2023-07-25 16:11:21,635 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-25 16:11:21,637 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-25 16:11:21,640 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-25 16:11:21,641 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10207773280, jitterRate=-0.04932703077793121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-25 16:11:21,641 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-25 16:11:21,641 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-25 16:11:21,641 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-25 16:11:21,641 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-25 16:11:21,641 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-25 16:11:21,641 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-25 16:11:21,642 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-25 16:11:21,643 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-25 16:11:21,648 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-25 16:11:21,648 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-25 16:11:21,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-25 16:11:21,667 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-25 16:11:21,670 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-25 16:11:21,822 DEBUG [jenkins-hbase6:35973] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-25 16:11:21,824 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44091,1690301479338, state=OPENING 2023-07-25 16:11:21,831 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-25 16:11:21,833 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:21,833 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-25 16:11:21,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44091,1690301479338}] 2023-07-25 16:11:22,021 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:22,023 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-25 16:11:22,027 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:46266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-25 16:11:22,037 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-25 16:11:22,037 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-25 16:11:22,041 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44091%2C1690301479338.meta, suffix=.meta, logDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/WALs/jenkins-hbase6.apache.org,44091,1690301479338, archiveDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/oldWALs, maxLogs=32 2023-07-25 16:11:22,067 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46803,DS-a259198f-a35c-460c-ab4e-373f1f9c206d,DISK] 2023-07-25 16:11:22,073 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/WALs/jenkins-hbase6.apache.org,44091,1690301479338/jenkins-hbase6.apache.org%2C44091%2C1690301479338.meta.1690301482043.meta 2023-07-25 16:11:22,073 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46803,DS-a259198f-a35c-460c-ab4e-373f1f9c206d,DISK]] 2023-07-25 16:11:22,074 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-25 16:11:22,075 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-25 16:11:22,076 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-25 16:11:22,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=VisibilityLabelsService 2023-07-25 16:11:22,084 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-25 16:11:22,085 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-25 16:11:22,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-25 16:11:22,087 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-25 16:11:22,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-25 16:11:22,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:22,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-25 16:11:22,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-25 16:11:22,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-25 16:11:22,107 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/info 2023-07-25 16:11:22,107 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/info 2023-07-25 16:11:22,108 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-25 16:11:22,109 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:22,109 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-25 16:11:22,110 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/rep_barrier 2023-07-25 16:11:22,110 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/rep_barrier 2023-07-25 16:11:22,111 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-25 16:11:22,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:22,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-25 16:11:22,114 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/table 2023-07-25 16:11:22,114 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/table 2023-07-25 16:11:22,114 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-25 16:11:22,115 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:22,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740 2023-07-25 16:11:22,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740 2023-07-25 16:11:22,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-25 16:11:22,126 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-25 16:11:22,128 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11065780160, jitterRate=0.03058108687400818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-25 16:11:22,137 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:22,149 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-25 16:11:22,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690301482013 2023-07-25 16:11:22,182 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-25 16:11:22,183 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-25 16:11:22,183 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44091,1690301479338, state=OPEN 2023-07-25 16:11:22,189 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-25 16:11:22,189 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-25 16:11:22,193 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-25 16:11:22,193 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44091,1690301479338 in 353 msec 2023-07-25 16:11:22,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-25 16:11:22,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 538 msec 2023-07-25 16:11:22,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5580 sec 2023-07-25 16:11:22,204 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690301482204, completionTime=-1 2023-07-25 16:11:22,204 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-25 16:11:22,205 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-25 16:11:22,285 DEBUG [hconnection-0x5d3e72a2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:22,289 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:46268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:22,314 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-25 16:11:22,314 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690301542314 2023-07-25 16:11:22,314 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690301602314 2023-07-25 16:11:22,314 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 108 msec 2023-07-25 16:11:22,338 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,35973,1690301477364-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:22,339 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,35973,1690301477364-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:22,339 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,35973,1690301477364-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:22,341 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:35973, period=300000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:22,341 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:22,346 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-25 16:11:22,357 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-25 16:11:22,359 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-25 16:11:22,368 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-25 16:11:22,371 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-25 16:11:22,374 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-25 16:11:22,398 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/namespace/7353e2baf07009b6c574276304929634 2023-07-25 16:11:22,401 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/namespace/7353e2baf07009b6c574276304929634 empty. 2023-07-25 16:11:22,402 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/namespace/7353e2baf07009b6c574276304929634 2023-07-25 16:11:22,402 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-25 16:11:22,434 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-25 16:11:22,437 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7353e2baf07009b6c574276304929634, NAME => 'hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp 2023-07-25 16:11:22,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:22,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7353e2baf07009b6c574276304929634, disabling compactions & flushes 2023-07-25 16:11:22,865 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:11:22,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:11:22,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. after waiting 0 ms 2023-07-25 16:11:22,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:11:22,865 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:11:22,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7353e2baf07009b6c574276304929634: 2023-07-25 16:11:22,871 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-25 16:11:22,892 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690301482874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690301482874"}]},"ts":"1690301482874"} 2023-07-25 16:11:22,922 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-25 16:11:22,924 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-25 16:11:22,929 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301482925"}]},"ts":"1690301482925"} 2023-07-25 16:11:22,935 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-25 16:11:22,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7353e2baf07009b6c574276304929634, ASSIGN}] 2023-07-25 16:11:22,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7353e2baf07009b6c574276304929634, ASSIGN 2023-07-25 16:11:22,947 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7353e2baf07009b6c574276304929634, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44091,1690301479338; forceNewPlan=false, retain=false 2023-07-25 16:11:23,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7353e2baf07009b6c574276304929634, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:23,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690301483098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690301483098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690301483098"}]},"ts":"1690301483098"} 2023-07-25 16:11:23,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7353e2baf07009b6c574276304929634, server=jenkins-hbase6.apache.org,44091,1690301479338}] 2023-07-25 16:11:23,264 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:11:23,265 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7353e2baf07009b6c574276304929634, NAME => 'hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.', STARTKEY => '', ENDKEY => ''} 2023-07-25 16:11:23,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. service=AccessControlService 2023-07-25 16:11:23,266 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-25 16:11:23,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. service=VisibilityLabelsService 2023-07-25 16:11:23,266 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-25 16:11:23,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7353e2baf07009b6c574276304929634 2023-07-25 16:11:23,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:23,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 7353e2baf07009b6c574276304929634 2023-07-25 16:11:23,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 7353e2baf07009b6c574276304929634 2023-07-25 16:11:23,269 INFO [StoreOpener-7353e2baf07009b6c574276304929634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7353e2baf07009b6c574276304929634 2023-07-25 16:11:23,272 DEBUG [StoreOpener-7353e2baf07009b6c574276304929634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634/info 2023-07-25 16:11:23,272 DEBUG [StoreOpener-7353e2baf07009b6c574276304929634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634/info 2023-07-25 16:11:23,272 INFO [StoreOpener-7353e2baf07009b6c574276304929634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7353e2baf07009b6c574276304929634 columnFamilyName info 2023-07-25 16:11:23,273 INFO [StoreOpener-7353e2baf07009b6c574276304929634-1] regionserver.HStore(310): Store=7353e2baf07009b6c574276304929634/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:23,275 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634 2023-07-25 16:11:23,276 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634 2023-07-25 16:11:23,281 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 7353e2baf07009b6c574276304929634 2023-07-25 16:11:23,286 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-25 16:11:23,288 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 7353e2baf07009b6c574276304929634; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11282361600, jitterRate=0.05075180530548096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-25 16:11:23,288 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 7353e2baf07009b6c574276304929634: 2023-07-25 16:11:23,291 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634., pid=6, masterSystemTime=1690301483257 2023-07-25 16:11:23,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:11:23,295 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:11:23,296 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7353e2baf07009b6c574276304929634, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:23,296 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690301483295"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690301483295"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690301483295"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690301483295"}]},"ts":"1690301483295"} 2023-07-25 16:11:23,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-25 16:11:23,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7353e2baf07009b6c574276304929634, server=jenkins-hbase6.apache.org,44091,1690301479338 in 197 msec 2023-07-25 16:11:23,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-25 16:11:23,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7353e2baf07009b6c574276304929634, ASSIGN in 362 msec 2023-07-25 16:11:23,310 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-25 16:11:23,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301483310"}]},"ts":"1690301483310"} 2023-07-25 16:11:23,314 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-25 16:11:23,317 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-25 16:11:23,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 957 msec 2023-07-25 16:11:23,372 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-25 16:11:23,375 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-25 16:11:23,375 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:23,424 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-25 16:11:23,445 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-25 16:11:23,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-07-25 16:11:23,458 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-25 16:11:23,470 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-25 16:11:23,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-25 16:11:23,494 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-25 16:11:23,497 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-25 16:11:23,499 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.909sec 2023-07-25 16:11:23,501 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2023-07-25 16:11:23,502 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-25 16:11:23,503 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2023-07-25 16:11:23,504 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2023-07-25 16:11:23,506 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2023-07-25 16:11:23,507 INFO [master/jenkins-hbase6:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2023-07-25 16:11:23,507 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-25 16:11:23,510 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,512 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952 empty. 2023-07-25 16:11:23,513 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,513 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2023-07-25 16:11:23,516 INFO [master/jenkins-hbase6:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2023-07-25 16:11:23,517 INFO [master/jenkins-hbase6:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2023-07-25 16:11:23,519 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:23,520 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-25 16:11:23,522 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-25 16:11:23,522 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-25 16:11:23,525 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,35973,1690301477364-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-25 16:11:23,526 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,35973,1690301477364-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-25 16:11:23,548 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x760bf804 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:23,552 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2023-07-25 16:11:23,561 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2066fced79ac7b208e1db37ceb4d8952, NAME => 'hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp 2023-07-25 16:11:23,563 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40810b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:23,574 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-25 16:11:23,581 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-25 16:11:23,583 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:23,583 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 2066fced79ac7b208e1db37ceb4d8952, disabling compactions & flushes 2023-07-25 16:11:23,583 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:11:23,583 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:11:23,583 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. after waiting 0 ms 2023-07-25 16:11:23,583 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:11:23,583 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:11:23,583 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 2066fced79ac7b208e1db37ceb4d8952: 2023-07-25 16:11:23,584 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-25 16:11:23,586 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-25 16:11:23,587 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2023-07-25 16:11:23,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1690301483588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690301483588"}]},"ts":"1690301483588"} 2023-07-25 16:11:23,590 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 10 2023-07-25 16:11:23,591 DEBUG [hconnection-0x5e538d11-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:23,591 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:23,592 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-25 16:11:23,592 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17 empty. 2023-07-25 16:11:23,593 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-25 16:11:23,593 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301483593"}]},"ts":"1690301483593"} 2023-07-25 16:11:23,594 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:23,594 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-25 16:11:23,597 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2023-07-25 16:11:23,598 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-25 16:11:23,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=2066fced79ac7b208e1db37ceb4d8952, ASSIGN}] 2023-07-25 16:11:23,603 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=2066fced79ac7b208e1db37ceb4d8952, ASSIGN 2023-07-25 16:11:23,606 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=2066fced79ac7b208e1db37ceb4d8952, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44091,1690301479338; forceNewPlan=false, retain=false 2023-07-25 16:11:23,608 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:46282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:23,610 INFO [Listener at localhost/35987] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:11:23,611 DEBUG [Listener at localhost/35987] client.AbstractTestShell(63): Configure jruby runtime, cluster set to org.apache.hadoop.hbase.HBaseTestingUtility@1e5e5a6 2023-07-25 16:11:23,658 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-25 16:11:23,665 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 138beb39ba785bfbe1f63b99c3a28d17, NAME => 'hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp 2023-07-25 16:11:23,758 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2066fced79ac7b208e1db37ceb4d8952, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:23,758 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1690301483757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690301483757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690301483757"}]},"ts":"1690301483757"} 2023-07-25 16:11:23,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2066fced79ac7b208e1db37ceb4d8952, server=jenkins-hbase6.apache.org,44091,1690301479338}] 2023-07-25 16:11:23,853 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-25 16:11:23,921 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:11:23,921 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2066fced79ac7b208e1db37ceb4d8952, NAME => 'hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952.', STARTKEY => '', ENDKEY => ''} 2023-07-25 16:11:23,921 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. service=AccessControlService 2023-07-25 16:11:23,922 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-25 16:11:23,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. service=VisibilityLabelsService 2023-07-25 16:11:23,922 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-25 16:11:23,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:23,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,924 INFO [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,926 DEBUG [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/q 2023-07-25 16:11:23,927 DEBUG [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/q 2023-07-25 16:11:23,927 INFO [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2066fced79ac7b208e1db37ceb4d8952 columnFamilyName q 2023-07-25 16:11:23,928 INFO [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] regionserver.HStore(310): Store=2066fced79ac7b208e1db37ceb4d8952/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:23,928 INFO [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,931 DEBUG [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/u 2023-07-25 16:11:23,932 DEBUG [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/u 2023-07-25 16:11:23,932 INFO [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2066fced79ac7b208e1db37ceb4d8952 columnFamilyName u 2023-07-25 16:11:23,933 INFO [StoreOpener-2066fced79ac7b208e1db37ceb4d8952-1] regionserver.HStore(310): Store=2066fced79ac7b208e1db37ceb4d8952/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:23,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,941 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-25 16:11:23,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:11:23,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-25 16:11:23,962 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 2066fced79ac7b208e1db37ceb4d8952; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9716111360, jitterRate=-0.09511661529541016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-25 16:11:23,962 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 2066fced79ac7b208e1db37ceb4d8952: 2023-07-25 16:11:23,964 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952., pid=12, masterSystemTime=1690301483915 2023-07-25 16:11:23,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:11:23,968 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:11:23,969 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2066fced79ac7b208e1db37ceb4d8952, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:23,970 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1690301483969"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690301483969"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690301483969"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690301483969"}]},"ts":"1690301483969"} 2023-07-25 16:11:23,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-07-25 16:11:23,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2066fced79ac7b208e1db37ceb4d8952, server=jenkins-hbase6.apache.org,44091,1690301479338 in 213 msec 2023-07-25 16:11:23,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=9 2023-07-25 16:11:23,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=2066fced79ac7b208e1db37ceb4d8952, ASSIGN in 377 msec 2023-07-25 16:11:23,983 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-25 16:11:23,984 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301483983"}]},"ts":"1690301483983"} 2023-07-25 16:11:23,986 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2023-07-25 16:11:23,990 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2023-07-25 16:11:23,990 WARN [PEWorker-5] access.AccessController(784): Not adding owner permission for table hbase:quota. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-25 16:11:23,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 489 msec 2023-07-25 16:11:24,082 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:24,083 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 138beb39ba785bfbe1f63b99c3a28d17, disabling compactions & flushes 2023-07-25 16:11:24,083 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:11:24,083 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:11:24,083 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. after waiting 0 ms 2023-07-25 16:11:24,083 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:11:24,083 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:11:24,083 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 138beb39ba785bfbe1f63b99c3a28d17: 2023-07-25 16:11:24,091 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-25 16:11:24,092 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690301484092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690301484092"}]},"ts":"1690301484092"} 2023-07-25 16:11:24,096 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-25 16:11:24,097 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-25 16:11:24,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301484097"}]},"ts":"1690301484097"} 2023-07-25 16:11:24,100 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-25 16:11:24,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=138beb39ba785bfbe1f63b99c3a28d17, ASSIGN}] 2023-07-25 16:11:24,108 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=138beb39ba785bfbe1f63b99c3a28d17, ASSIGN 2023-07-25 16:11:24,110 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=138beb39ba785bfbe1f63b99c3a28d17, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44091,1690301479338; forceNewPlan=false, retain=false 2023-07-25 16:11:24,261 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=138beb39ba785bfbe1f63b99c3a28d17, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:24,262 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690301484261"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690301484261"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690301484261"}]},"ts":"1690301484261"} 2023-07-25 16:11:24,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 138beb39ba785bfbe1f63b99c3a28d17, server=jenkins-hbase6.apache.org,44091,1690301479338}] 2023-07-25 16:11:24,354 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-25 16:11:24,492 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:11:24,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 138beb39ba785bfbe1f63b99c3a28d17, NAME => 'hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17.', STARTKEY => '', ENDKEY => ''} 2023-07-25 16:11:24,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. service=AccessControlService 2023-07-25 16:11:24,493 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-25 16:11:24,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. service=VisibilityLabelsService 2023-07-25 16:11:24,493 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-25 16:11:24,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:24,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:24,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:24,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:24,495 INFO [StoreOpener-138beb39ba785bfbe1f63b99c3a28d17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:24,497 DEBUG [StoreOpener-138beb39ba785bfbe1f63b99c3a28d17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17/l 2023-07-25 16:11:24,497 DEBUG [StoreOpener-138beb39ba785bfbe1f63b99c3a28d17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17/l 2023-07-25 16:11:24,498 INFO [StoreOpener-138beb39ba785bfbe1f63b99c3a28d17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 138beb39ba785bfbe1f63b99c3a28d17 columnFamilyName l 2023-07-25 16:11:24,499 INFO [StoreOpener-138beb39ba785bfbe1f63b99c3a28d17-1] regionserver.HStore(310): Store=138beb39ba785bfbe1f63b99c3a28d17/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:24,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:24,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:24,505 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:11:24,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-25 16:11:24,510 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 138beb39ba785bfbe1f63b99c3a28d17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10359957120, jitterRate=-0.03515380620956421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-25 16:11:24,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 138beb39ba785bfbe1f63b99c3a28d17: 2023-07-25 16:11:24,512 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17., pid=14, masterSystemTime=1690301484486 2023-07-25 16:11:24,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:11:24,516 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:11:24,517 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=138beb39ba785bfbe1f63b99c3a28d17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:24,517 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690301484517"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690301484517"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690301484517"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690301484517"}]},"ts":"1690301484517"} 2023-07-25 16:11:24,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-25 16:11:24,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 138beb39ba785bfbe1f63b99c3a28d17, server=jenkins-hbase6.apache.org,44091,1690301479338 in 255 msec 2023-07-25 16:11:24,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-07-25 16:11:24,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=138beb39ba785bfbe1f63b99c3a28d17, ASSIGN in 418 msec 2023-07-25 16:11:24,531 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-25 16:11:24,531 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301484531"}]},"ts":"1690301484531"} 2023-07-25 16:11:24,535 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-25 16:11:24,538 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-25 16:11:24,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=hbase:acl in 963 msec 2023-07-25 16:11:25,104 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-25 16:11:25,105 INFO [master/jenkins-hbase6:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 10 completed 2023-07-25 16:11:25,108 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-25 16:11:25,110 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:labels 2023-07-25 16:11:25,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_PRE_OPERATION 2023-07-25 16:11:25,114 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "labels" procId is: 15 2023-07-25 16:11:25,114 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-25 16:11:25,115 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-25 16:11:25,118 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:25,119 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375 empty. 2023-07-25 16:11:25,119 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:25,119 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:labels regions 2023-07-25 16:11:25,364 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-25 16:11:25,536 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/hbase/labels/.tabledesc/.tableinfo.0000000001 2023-07-25 16:11:25,538 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c8d3a3854b656fdfce8780aecf9c375, NAME => 'hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp 2023-07-25 16:11:25,864 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-25 16:11:25,978 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(866): Instantiated hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:25,979 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1604): Closing 1c8d3a3854b656fdfce8780aecf9c375, disabling compactions & flushes 2023-07-25 16:11:25,979 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1626): Closing region hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:11:25,979 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:11:25,980 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. after waiting 0 ms 2023-07-25 16:11:25,980 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:11:25,980 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1838): Closed hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:11:25,980 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1558): Region close journal for 1c8d3a3854b656fdfce8780aecf9c375: 2023-07-25 16:11:25,984 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ADD_TO_META 2023-07-25 16:11:25,985 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1690301485985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690301485985"}]},"ts":"1690301485985"} 2023-07-25 16:11:25,988 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-25 16:11:25,989 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-25 16:11:25,990 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301485990"}]},"ts":"1690301485990"} 2023-07-25 16:11:25,992 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLING in hbase:meta 2023-07-25 16:11:26,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=1c8d3a3854b656fdfce8780aecf9c375, ASSIGN}] 2023-07-25 16:11:26,036 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=1c8d3a3854b656fdfce8780aecf9c375, ASSIGN 2023-07-25 16:11:26,039 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:labels, region=1c8d3a3854b656fdfce8780aecf9c375, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44091,1690301479338; forceNewPlan=false, retain=false 2023-07-25 16:11:26,191 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1c8d3a3854b656fdfce8780aecf9c375, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:26,191 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1690301486191"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690301486191"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690301486191"}]},"ts":"1690301486191"} 2023-07-25 16:11:26,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 1c8d3a3854b656fdfce8780aecf9c375, server=jenkins-hbase6.apache.org,44091,1690301479338}] 2023-07-25 16:11:26,358 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:11:26,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c8d3a3854b656fdfce8780aecf9c375, NAME => 'hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375.', STARTKEY => '', ENDKEY => ''} 2023-07-25 16:11:26,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. service=AccessControlService 2023-07-25 16:11:26,359 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-25 16:11:26,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. service=VisibilityLabelsService 2023-07-25 16:11:26,360 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-25 16:11:26,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table labels 1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:26,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:26,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:26,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:26,363 INFO [StoreOpener-1c8d3a3854b656fdfce8780aecf9c375-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:26,367 DEBUG [StoreOpener-1c8d3a3854b656fdfce8780aecf9c375-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375/f 2023-07-25 16:11:26,367 DEBUG [StoreOpener-1c8d3a3854b656fdfce8780aecf9c375-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375/f 2023-07-25 16:11:26,367 INFO [StoreOpener-1c8d3a3854b656fdfce8780aecf9c375-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c8d3a3854b656fdfce8780aecf9c375 columnFamilyName f 2023-07-25 16:11:26,369 INFO [StoreOpener-1c8d3a3854b656fdfce8780aecf9c375-1] regionserver.HStore(310): Store=1c8d3a3854b656fdfce8780aecf9c375/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:26,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:26,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:26,383 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:11:26,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-25 16:11:26,388 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 1c8d3a3854b656fdfce8780aecf9c375; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@49010756, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-25 16:11:26,402 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2023-07-25 16:11:26,402 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 1c8d3a3854b656fdfce8780aecf9c375: 2023-07-25 16:11:26,404 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375., pid=17, masterSystemTime=1690301486349 2023-07-25 16:11:26,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(686): ZK sync() operation took 5ms 2023-07-25 16:11:26,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:11:26,407 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:11:26,408 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1c8d3a3854b656fdfce8780aecf9c375, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:26,408 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1690301486408"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690301486408"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690301486408"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690301486408"}]},"ts":"1690301486408"} 2023-07-25 16:11:26,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-25 16:11:26,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 1c8d3a3854b656fdfce8780aecf9c375, server=jenkins-hbase6.apache.org,44091,1690301479338 in 217 msec 2023-07-25 16:11:26,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-25 16:11:26,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=hbase:labels, region=1c8d3a3854b656fdfce8780aecf9c375, ASSIGN in 381 msec 2023-07-25 16:11:26,420 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-25 16:11:26,420 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301486420"}]},"ts":"1690301486420"} 2023-07-25 16:11:26,423 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLED in hbase:meta 2023-07-25 16:11:26,430 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_POST_OPERATION 2023-07-25 16:11:26,436 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey hbase:labels jenkins.hfs.0: RWXCA 2023-07-25 16:11:26,457 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44091] access.PermissionStorage(611): Read acl: entry[hbase:labels], kv [jenkins.hfs.0: RWXCA] 2023-07-25 16:11:26,503 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-25 16:11:26,503 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-25 16:11:26,503 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:11:26,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-25 16:11:26,513 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-25 16:11:26,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; CreateTableProcedure table=hbase:labels in 1.4020 sec 2023-07-25 16:11:26,615 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-25 16:11:26,615 INFO [master/jenkins-hbase6:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:labels, procId: 15 completed 2023-07-25 16:11:26,643 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-25 16:11:26,919 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-25 16:11:26,922 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-25 16:11:26,925 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:labels' 2023-07-25 16:11:26,928 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-25 16:11:26,931 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2023-07-25 16:11:27,082 INFO [Listener at localhost/35987] hbase.ResourceChecker(147): before: client.TestQuotasShell#testRunShellTests Thread=237, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=173, AvailableMemoryMB=1780 2023-07-25 16:11:27,084 INFO [Listener at localhost/35987] client.AbstractTestShell(93): Starting ruby tests. includes: quotas_test.rb excludes: 2023-07-25 16:11:27,636 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties Ruby description: jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 25.362-b09 on 1.8.0_362-b09 +jit [linux-x86_64] 2023-07-25 16:11:27,773 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:11:27,774 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-25 16:11:27,774 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:11:27,774 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase RegionObservers 2023-07-25 16:11:27,774 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:11:27,775 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-25 16:11:27,775 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:11:27,775 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-25 16:11:27,775 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-25 16:11:27,775 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-25 16:11:27,776 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-25 16:11:27,776 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2023-07-25 16:11:27,776 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-25 16:11:27,776 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-25 16:11:27,776 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:11:27,776 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase MasterObservers uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag Running tests... Skip commands_test.rb because of not included Skip formatter_test.rb because of not included Skip converter_test.rb because of not included Skip list_locks_test.rb because of not included Skip list_procedures_test.rb because of not included Skip rsgroup_shell_test.rb because of not included Skip noninteractive_test.rb because of not included Skip shell_test.rb because of not included Skip table_test.rb because of not included Skip admin2_test.rb because of not included Skip hbase_test.rb because of not included Skip taskmonitor_test.rb because of not included Skip admin_test.rb because of not included Skip replication_admin_test.rb because of not included loading test file 'quotas_test.rb'. Skip security_admin_test.rb because of not included Skip visibility_labels_admin_test.rb because of not included Loaded suite src/test/ruby/tests_runner Started 2023-07-25 16:11:30,501 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x5efedebc to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:30,518 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4eed1a9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:30,556 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:30,564 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:30,590 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:11:30,594 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-25 16:11:30,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-25 16:11:30,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase_shell_quota_tests_table 2023-07-25 16:11:30,613 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_PRE_OPERATION 2023-07-25 16:11:30,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "hbase_shell_quota_tests_table" procId is: 18 2023-07-25 16:11:30,617 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-25 16:11:30,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-25 16:11:30,625 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:30,626 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc empty. 2023-07-25 16:11:30,628 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:30,628 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase_shell_quota_tests_table regions 2023-07-25 16:11:30,661 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp/data/default/hbase_shell_quota_tests_table/.tabledesc/.tableinfo.0000000001 2023-07-25 16:11:30,663 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(7675): creating {ENCODED => a40a6cc2a33af663d9cc72cadf80c7cc, NAME => 'hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.tmp 2023-07-25 16:11:30,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-25 16:11:31,115 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:31,116 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1604): Closing a40a6cc2a33af663d9cc72cadf80c7cc, disabling compactions & flushes 2023-07-25 16:11:31,116 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:31,116 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:31,116 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. after waiting 0 ms 2023-07-25 16:11:31,116 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:31,116 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:31,116 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1558): Region close journal for a40a6cc2a33af663d9cc72cadf80c7cc: 2023-07-25 16:11:31,122 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ADD_TO_META 2023-07-25 16:11:31,123 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690301491123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690301491123"}]},"ts":"1690301491123"} 2023-07-25 16:11:31,126 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-25 16:11:31,127 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-25 16:11:31,127 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301491127"}]},"ts":"1690301491127"} 2023-07-25 16:11:31,129 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLING in hbase:meta 2023-07-25 16:11:31,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=a40a6cc2a33af663d9cc72cadf80c7cc, ASSIGN}] 2023-07-25 16:11:31,136 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=a40a6cc2a33af663d9cc72cadf80c7cc, ASSIGN 2023-07-25 16:11:31,137 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=a40a6cc2a33af663d9cc72cadf80c7cc, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44091,1690301479338; forceNewPlan=false, retain=false 2023-07-25 16:11:31,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a40a6cc2a33af663d9cc72cadf80c7cc, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:31,289 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690301491288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690301491288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690301491288"}]},"ts":"1690301491288"} 2023-07-25 16:11:31,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure a40a6cc2a33af663d9cc72cadf80c7cc, server=jenkins-hbase6.apache.org,44091,1690301479338}] 2023-07-25 16:11:31,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-25 16:11:31,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:31,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a40a6cc2a33af663d9cc72cadf80c7cc, NAME => 'hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.', STARTKEY => '', ENDKEY => ''} 2023-07-25 16:11:31,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. service=AccessControlService 2023-07-25 16:11:31,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-25 16:11:31,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. service=VisibilityLabelsService 2023-07-25 16:11:31,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-25 16:11:31,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table hbase_shell_quota_tests_table a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:31,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-25 16:11:31,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:31,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:31,455 INFO [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family x of region a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:31,459 DEBUG [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x 2023-07-25 16:11:31,459 DEBUG [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x 2023-07-25 16:11:31,460 INFO [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a40a6cc2a33af663d9cc72cadf80c7cc columnFamilyName x 2023-07-25 16:11:31,461 INFO [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] regionserver.HStore(310): Store=a40a6cc2a33af663d9cc72cadf80c7cc/x, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:31,461 INFO [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family y of region a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:31,463 DEBUG [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/y 2023-07-25 16:11:31,463 DEBUG [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/y 2023-07-25 16:11:31,464 INFO [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a40a6cc2a33af663d9cc72cadf80c7cc columnFamilyName y 2023-07-25 16:11:31,465 INFO [StoreOpener-a40a6cc2a33af663d9cc72cadf80c7cc-1] regionserver.HStore(310): Store=a40a6cc2a33af663d9cc72cadf80c7cc/y, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-25 16:11:31,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:31,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:31,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase_shell_quota_tests_table descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-25 16:11:31,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:11:31,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-25 16:11:31,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened a40a6cc2a33af663d9cc72cadf80c7cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11914475840, jitterRate=0.1096220314502716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-25 16:11:31,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for a40a6cc2a33af663d9cc72cadf80c7cc: 2023-07-25 16:11:31,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc., pid=20, masterSystemTime=1690301491445 2023-07-25 16:11:31,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:31,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:31,490 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a40a6cc2a33af663d9cc72cadf80c7cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:31,491 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1690301491490"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690301491490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690301491490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690301491490"}]},"ts":"1690301491490"} 2023-07-25 16:11:31,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-25 16:11:31,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure a40a6cc2a33af663d9cc72cadf80c7cc, server=jenkins-hbase6.apache.org,44091,1690301479338 in 201 msec 2023-07-25 16:11:31,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=18 2023-07-25 16:11:31,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=a40a6cc2a33af663d9cc72cadf80c7cc, ASSIGN in 362 msec 2023-07-25 16:11:31,501 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-25 16:11:31,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690301491501"}]},"ts":"1690301491501"} 2023-07-25 16:11:31,503 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLED in hbase:meta 2023-07-25 16:11:31,507 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_POST_OPERATION 2023-07-25 16:11:31,507 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey hbase_shell_quota_tests_table jenkins: RWXCA 2023-07-25 16:11:31,510 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44091] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-25 16:11:31,512 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-25 16:11:31,512 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-25 16:11:31,516 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-25 16:11:31,516 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-25 16:11:31,517 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-25 16:11:31,517 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-25 16:11:31,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; CreateTableProcedure table=hbase_shell_quota_tests_table in 907 msec 2023-07-25 16:11:32,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-25 16:11:32,132 INFO [Listener at localhost/35987] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:hbase_shell_quota_tests_table, procId: 18 completed Created table hbase_shell_quota_tests_table Took 1.5645 seconds Took 0.0419 seconds 2023-07-25 16:11:32,267 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x548be172 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,274 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3978545e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,287 DEBUG [hconnection-0x582bd3ce-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,291 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,304 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x548be172 to 127.0.0.1:62218 2023-07-25 16:11:32,305 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0063 seconds 2023-07-25 16:11:32,316 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x5e997ce4 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,320 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4eae5c93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,323 DEBUG [hconnection-0x44541ed6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,324 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,330 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e997ce4 to 127.0.0.1:62218 2023-07-25 16:11:32,330 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0074 seconds 2023-07-25 16:11:32,340 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x6c7317a7 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,348 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64ced302, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,351 DEBUG [hconnection-0x71855f6e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,354 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,360 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c7317a7 to 127.0.0.1:62218 2023-07-25 16:11:32,360 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:32,363 INFO [Listener at localhost/35987] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:11:32,363 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5efedebc to 127.0.0.1:62218 2023-07-25 16:11:32,364 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:11:32,367 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x4165e54e to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,373 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62415cc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,376 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,380 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,394 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:11:32,398 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0170 seconds 2023-07-25 16:11:32,404 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x11b9db9d to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,439 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6db65fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,444 DEBUG [hconnection-0x291a1e0c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,450 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,460 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11b9db9d to 127.0.0.1:62218 2023-07-25 16:11:32,461 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0076 seconds 2023-07-25 16:11:32,472 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x47fca45c to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,479 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13beabfd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,481 DEBUG [hconnection-0x229ae717-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,486 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,490 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47fca45c to 127.0.0.1:62218 2023-07-25 16:11:32,490 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:32,492 INFO [Listener at localhost/35987] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:11:32,493 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4165e54e to 127.0.0.1:62218 2023-07-25 16:11:32,493 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:11:32,494 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x3bf596cc to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,504 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@693156a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,512 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,527 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,537 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:11:32,545 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0153 seconds 2023-07-25 16:11:32,553 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x7ca09a40 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,571 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b7420ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,587 DEBUG [hconnection-0x813df40-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,606 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,625 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ca09a40 to 127.0.0.1:62218 2023-07-25 16:11:32,626 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0068 seconds 2023-07-25 16:11:32,640 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x72e61156 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,646 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c126ac2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,649 DEBUG [hconnection-0x71deb9dc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,655 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,665 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72e61156 to 127.0.0.1:62218 2023-07-25 16:11:32,665 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0070 seconds 2023-07-25 16:11:32,678 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x056a96eb to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,704 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28d4cb2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,779 DEBUG [hconnection-0x123e4c9a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,788 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,798 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x056a96eb to 127.0.0.1:62218 2023-07-25 16:11:32,799 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:32,800 INFO [Listener at localhost/35987] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:11:32,800 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bf596cc to 127.0.0.1:62218 2023-07-25 16:11:32,801 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:11:32,803 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x0127bb11 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,819 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5afd2534, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,906 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,909 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,915 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:11:32,918 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0094 seconds 2023-07-25 16:11:32,925 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x018af4dd to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,931 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16529236, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,934 DEBUG [hconnection-0x48940415-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,938 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase_shell_quota_tests_table' 2023-07-25 16:11:32,938 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,944 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x018af4dd to 127.0.0.1:62218 2023-07-25 16:11:32,944 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0071 seconds 2023-07-25 16:11:32,956 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x306217ad to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,965 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39cc1c4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:32,968 DEBUG [hconnection-0x4000a5ba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:32,969 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:32,974 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x306217ad to 127.0.0.1:62218 2023-07-25 16:11:32,974 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:32,976 INFO [Listener at localhost/35987] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:11:32,976 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0127bb11 to 127.0.0.1:62218 2023-07-25 16:11:32,976 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:11:32,978 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x21a971ed to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:32,984 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@554f6d12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:33,080 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:33,082 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:33,087 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:11:33,089 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0084 seconds 2023-07-25 16:11:33,096 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x3a947c6d to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:33,101 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50d844cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:33,104 DEBUG [hconnection-0x7ed1943f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:33,106 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:33,113 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a947c6d to 127.0.0.1:62218 2023-07-25 16:11:33,113 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0045 seconds 2023-07-25 16:11:33,123 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x0bb92b9c to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:33,128 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e58b3ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:33,130 DEBUG [hconnection-0x69a8f82a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:33,132 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:33,137 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bb92b9c to 127.0.0.1:62218 2023-07-25 16:11:33,137 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:33,139 INFO [Listener at localhost/35987] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:11:33,139 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21a971ed to 127.0.0.1:62218 2023-07-25 16:11:33,139 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:11:33,141 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x6cc3d08f to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:33,146 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bc8a367, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:33,149 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:33,150 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:33,155 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:11:33,157 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0074 seconds 2023-07-25 16:11:33,182 DEBUG [regionserver/jenkins-hbase6:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:11:33,184 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService Took 0.0215 seconds Took 0.0021 seconds Took 0.0019 seconds Took 0.0017 seconds Took 0.0017 seconds Took 0.0018 seconds Took 0.0020 seconds Took 0.0022 seconds Took 0.0017 seconds Took 0.0020 seconds 2023-07-25 16:11:33,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-07-25 16:11:33,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-25 16:11:33,245 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-25 16:11:33,245 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-25 16:11:33,245 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-25 16:11:33,245 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-25 16:11:33,246 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,246 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:33,247 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-25 16:11:33,247 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-25 16:11:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-25 16:11:33,248 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,248 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-25 16:11:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:33,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-25 16:11:33,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:33,249 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-25 16:11:33,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-25 16:11:33,252 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-25 16:11:33,252 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-25 16:11:33,253 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-25 16:11:33,254 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-25 16:11:33,254 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-25 16:11:33,254 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:33,254 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. started... 2023-07-25 16:11:33,256 INFO [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a40a6cc2a33af663d9cc72cadf80c7cc 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-25 16:11:33,347 INFO [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=14 (bloomFilter=true), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/.tmp/x/33eea152adc9498b870450eb9f0af40f 2023-07-25 16:11:33,395 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/.tmp/x/33eea152adc9498b870450eb9f0af40f as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/33eea152adc9498b870450eb9f0af40f 2023-07-25 16:11:33,403 INFO [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/33eea152adc9498b870450eb9f0af40f, entries=10, sequenceid=14, filesize=5.0 K 2023-07-25 16:11:33,406 INFO [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for a40a6cc2a33af663d9cc72cadf80c7cc in 151ms, sequenceid=14, compaction requested=false 2023-07-25 16:11:33,407 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a40a6cc2a33af663d9cc72cadf80c7cc: 2023-07-25 16:11:33,408 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:33,408 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-25 16:11:33,408 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-25 16:11:33,408 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,408 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-25 16:11:33,408 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44091,1690301479338' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-25 16:11:33,415 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,415 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:33,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:33,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-25 16:11:33,415 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:33,416 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-25 16:11:33,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:33,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44091,1690301479338' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-25 16:11:33,419 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-25 16:11:33,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55de646d[Count = 0] remaining members to acquire global barrier 2023-07-25 16:11:33,419 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:33,425 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:33,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:33,425 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-25 16:11:33,425 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-25 16:11:33,425 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase6.apache.org,44091,1690301479338' in zk 2023-07-25 16:11:33,425 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,425 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-25 16:11:33,437 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-25 16:11:33,437 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,437 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-25 16:11:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-25 16:11:33,437 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-25 16:11:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase6.apache.org,44091,1690301479338': 2023-07-25 16:11:33,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44091,1690301479338' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-25 16:11:33,441 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-25 16:11:33,442 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-25 16:11:33,442 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-25 16:11:33,442 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-25 16:11:33,442 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-25 16:11:33,449 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,449 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:33,449 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-25 16:11:33,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-25 16:11:33,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:33,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-25 16:11:33,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-25 16:11:33,450 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:33,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:33,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:33,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,452 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:33,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:33,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,459 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,460 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-25 16:11:33,460 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:33,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-25 16:11:33,460 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:33,460 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-25 16:11:33,460 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:33,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-25 16:11:33,460 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-25 16:11:33,460 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:33,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-25 16:11:33,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-25 16:11:33,460 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:33,461 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:33,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-25 16:11:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-25 16:11:33,463 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-25 16:11:33,463 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-25 16:11:33,713 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-25 16:11:33,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.5103 seconds 2023-07-25 16:11:33,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-25 16:11:33,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690301493732 (current time:1690301493732). 2023-07-25 16:11:33,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-25 16:11:33,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ReadOnlyZKClient(139): Connect 0x3020ace5 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:33,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ee1dc93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:33,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:33,742 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:33,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3020ace5 to 127.0.0.1:62218 2023-07-25 16:11:33,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:33,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ReadOnlyZKClient(139): Connect 0x5d9db536 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:33,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4735f060, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:33,752 DEBUG [hconnection-0x2eef8ae9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:33,753 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:33,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d9db536 to 127.0.0.1:62218 2023-07-25 16:11:33,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:33,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-25 16:11:33,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-25 16:11:33,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-25 16:11:33,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-25 16:11:33,804 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-25 16:11:33,805 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=21, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1690302093805 2023-07-25 16:11:33,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-25 16:11:33,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-25 16:11:33,807 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=21, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-25 16:11:33,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-25 16:11:33,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 11 msec 2023-07-25 16:11:33,809 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-25 16:11:33,810 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1690302093810 2023-07-25 16:11:33,810 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-25 16:11:33,811 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-25 16:11:34,062 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-25 16:11:34,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-25 16:11:34,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-25 16:11:34,067 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-25 16:11:34,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,223 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_1' 2023-07-25 16:11:34,224 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-25 16:11:34,224 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_1' starting 'acquire' 2023-07-25 16:11:34,224 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_1', kicking off acquire phase on members. 2023-07-25 16:11:34,224 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,224 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,227 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-25 16:11:34,227 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-25 16:11:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-25 16:11:34,227 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,227 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-25 16:11:34,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-25 16:11:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_1 from table hbase_shell_quota_tests_table type FLUSH 2023-07-25 16:11:34,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,231 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_1' with timeout 300000ms 2023-07-25 16:11:34,231 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-25 16:11:34,232 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_1' starting 'acquire' stage 2023-07-25 16:11:34,232 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_1' locally acquired 2023-07-25 16:11:34,232 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44091,1690301479338' joining acquired barrier for procedure (hbase_shell_quota_tests_table_1) in zk 2023-07-25 16:11:34,233 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,233 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:34,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-25 16:11:34,234 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,234 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-25 16:11:34,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:34,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:34,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:34,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44091,1690301479338' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_1' on coordinator 2023-07-25 16:11:34,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dfda477[Count = 0] remaining members to acquire global barrier 2023-07-25 16:11:34,236 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_1' starting 'in-barrier' execution. 2023-07-25 16:11:34,236 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,237 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,237 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_1' received 'reached' from coordinator. 2023-07-25 16:11:34,237 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,237 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-25 16:11:34,238 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-25 16:11:34,238 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-25 16:11:34,238 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:34,239 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. started... 2023-07-25 16:11:34,239 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a40a6cc2a33af663d9cc72cadf80c7cc: 2023-07-25 16:11:34,240 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.' region-info for snapshot=hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,246 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-25 16:11:34,250 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/33eea152adc9498b870450eb9f0af40f] hfiles 2023-07-25 16:11:34,250 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/33eea152adc9498b870450eb9f0af40f for snapshot=hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,253 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-25 16:11:34,568 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-25 16:11:34,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-25 16:11:34,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-25 16:11:34,570 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-25 16:11:34,670 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. completed. 2023-07-25 16:11:34,670 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:34,670 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-25 16:11:34,670 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-25 16:11:34,670 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,670 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_1' locally completed 2023-07-25 16:11:34,670 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_1' completed for member 'jenkins-hbase6.apache.org,44091,1690301479338' in zk 2023-07-25 16:11:34,673 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,673 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_1' has notified controller of completion 2023-07-25 16:11:34,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:34,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-25 16:11:34,673 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-25 16:11:34,673 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_1' completed. 2023-07-25 16:11:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_1' member 'jenkins-hbase6.apache.org,44091,1690301479338': 2023-07-25 16:11:34,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44091,1690301479338' released barrier for procedure'hbase_shell_quota_tests_table_1', counting down latch. Waiting for 0 more 2023-07-25 16:11:34,677 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_1' execution completed 2023-07-25 16:11:34,677 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-25 16:11:34,677 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-25 16:11:34,677 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,677 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-25 16:11:34,679 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,679 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-25 16:11:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,679 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-25 16:11:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:34,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-25 16:11:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-25 16:11:34,680 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:34,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,682 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:34,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,692 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,692 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-25 16:11:34,692 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-25 16:11:34,692 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,692 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-25 16:11:34,692 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-25 16:11:34,693 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,692 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-25 16:11:34,693 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,693 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-25 16:11:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-25 16:11:34,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-25 16:11:34,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 to hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/hbase_shell_quota_tests_table_1 2023-07-25 16:11:35,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed 2023-07-25 16:11:35,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-25 16:11:35,162 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-25 16:11:35,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1690301493805Consolidate snapshot: hbase_shell_quota_tests_table_1 at 1690301494693 (+888 ms)Loading Region manifests for hbase_shell_quota_tests_table_1 at 1690301494693Writing data manifest for hbase_shell_quota_tests_table_1 at 1690301494705 (+12 ms)Verifying snapshot: hbase_shell_quota_tests_table_1 at 1690301494719 (+14 ms)Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed at 1690301495161 (+442 ms) 2023-07-25 16:11:35,164 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-25 16:11:35,166 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 1.3580 sec 2023-07-25 16:11:35,321 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-25 16:11:35,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-25 16:11:35,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 1.6021 seconds Took 0.0024 seconds Took 0.0024 seconds Took 0.0021 seconds Took 0.0018 seconds Took 0.0017 seconds Took 0.0023 seconds Took 0.0020 seconds Took 0.0018 seconds Took 0.0017 seconds Took 0.0017 seconds 2023-07-25 16:11:35,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-07-25 16:11:35,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] procedure.ProcedureCoordinator(143): Procedure hbase_shell_quota_tests_table was in running list but was completed. Accepting new attempt. 2023-07-25 16:11:35,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-25 16:11:35,365 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-25 16:11:35,365 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-25 16:11:35,366 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-25 16:11:35,366 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-25 16:11:35,366 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,366 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:35,368 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-25 16:11:35,368 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-25 16:11:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-25 16:11:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:35,368 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,368 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-25 16:11:35,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-25 16:11:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:35,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-25 16:11:35,369 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc hbase_shell_quota_tests_table is still present, removing 2023-07-25 16:11:35,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-25 16:11:35,370 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-25 16:11:35,370 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-25 16:11:35,370 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-25 16:11:35,370 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-25 16:11:35,370 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-25 16:11:35,370 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:35,370 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. started... 2023-07-25 16:11:35,371 INFO [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a40a6cc2a33af663d9cc72cadf80c7cc 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-25 16:11:35,786 INFO [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=28 (bloomFilter=true), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/.tmp/x/fac333f4810c4c80a60d79315caf2bc6 2023-07-25 16:11:35,796 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/.tmp/x/fac333f4810c4c80a60d79315caf2bc6 as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/fac333f4810c4c80a60d79315caf2bc6 2023-07-25 16:11:35,808 INFO [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/fac333f4810c4c80a60d79315caf2bc6, entries=10, sequenceid=28, filesize=5.0 K 2023-07-25 16:11:35,810 INFO [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for a40a6cc2a33af663d9cc72cadf80c7cc in 439ms, sequenceid=28, compaction requested=false 2023-07-25 16:11:35,810 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a40a6cc2a33af663d9cc72cadf80c7cc: 2023-07-25 16:11:35,810 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:35,811 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-25 16:11:35,811 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-25 16:11:35,812 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,812 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-25 16:11:35,812 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44091,1690301479338' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-25 16:11:35,814 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:35,814 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-25 16:11:35,814 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:35,814 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-25 16:11:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:35,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44091,1690301479338' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-25 16:11:35,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77cbe642[Count = 0] remaining members to acquire global barrier 2023-07-25 16:11:35,817 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-25 16:11:35,817 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:35,818 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:35,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:35,819 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-25 16:11:35,819 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-25 16:11:35,819 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase6.apache.org,44091,1690301479338' in zk 2023-07-25 16:11:35,819 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,819 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-25 16:11:35,824 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-25 16:11:35,824 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,824 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-25 16:11:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,824 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-25 16:11:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-25 16:11:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:35,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:35,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:35,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase6.apache.org,44091,1690301479338': 2023-07-25 16:11:35,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44091,1690301479338' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-25 16:11:35,829 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-25 16:11:35,829 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-25 16:11:35,829 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-25 16:11:35,829 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-25 16:11:35,829 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-25 16:11:35,831 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-25 16:11:35,831 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,831 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-25 16:11:35,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:35,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-25 16:11:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-25 16:11:35,832 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,834 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-25 16:11:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,836 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,836 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-25 16:11:35,837 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:35,837 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-25 16:11:35,837 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-25 16:11:35,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-25 16:11:35,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-25 16:11:35,837 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:35,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-25 16:11:35,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table because node does not exist (not an error) 2023-07-25 16:11:35,837 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-25 16:11:35,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-25 16:11:35,837 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:35,838 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-25 16:11:35,838 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-25 16:11:35,838 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-25 16:11:35,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-25 16:11:35,839 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-25 16:11:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-25 16:11:36,089 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-25 16:11:36,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.7360 seconds 2023-07-25 16:11:36,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-25 16:11:36,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690301496093 (current time:1690301496093). 2023-07-25 16:11:36,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-25 16:11:36,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ReadOnlyZKClient(139): Connect 0x387a036c to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:36,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e064f26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:36,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:36,101 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:39502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:36,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x387a036c to 127.0.0.1:62218 2023-07-25 16:11:36,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:36,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ReadOnlyZKClient(139): Connect 0x2fe404a4 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:11:36,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47ed1357, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:11:36,110 DEBUG [hconnection-0x1b4e0bf3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:11:36,111 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:39512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:11:36,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fe404a4 to 127.0.0.1:62218 2023-07-25 16:11:36,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:11:36,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-25 16:11:36,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-25 16:11:36,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-25 16:11:36,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-25 16:11:36,120 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-25 16:11:36,121 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=23, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1690302096120 2023-07-25 16:11:36,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-25 16:11:36,121 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-25 16:11:36,121 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-25 16:11:36,122 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-25 16:11:36,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-25 16:11:36,122 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=23, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-25 16:11:36,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 5 msec 2023-07-25 16:11:36,125 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-25 16:11:36,125 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=24, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1690302096125 2023-07-25 16:11:36,372 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-25 16:11:36,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-25 16:11:36,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-25 16:11:36,375 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-25 16:11:36,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,537 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_2' 2023-07-25 16:11:36,537 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-25 16:11:36,537 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_2' starting 'acquire' 2023-07-25 16:11:36,537 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_2', kicking off acquire phase on members. 2023-07-25 16:11:36,538 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,538 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,539 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-25 16:11:36,539 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-25 16:11:36,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-25 16:11:36,540 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,540 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-25 16:11:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-25 16:11:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_2 from table hbase_shell_quota_tests_table type FLUSH 2023-07-25 16:11:36,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,546 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_2' with timeout 300000ms 2023-07-25 16:11:36,546 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-25 16:11:36,547 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_2' starting 'acquire' stage 2023-07-25 16:11:36,547 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_2' locally acquired 2023-07-25 16:11:36,547 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44091,1690301479338' joining acquired barrier for procedure (hbase_shell_quota_tests_table_2) in zk 2023-07-25 16:11:36,549 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,549 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-25 16:11:36,549 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,549 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-25 16:11:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:36,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44091,1690301479338' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_2' on coordinator 2023-07-25 16:11:36,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@646bf2c[Count = 0] remaining members to acquire global barrier 2023-07-25 16:11:36,551 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_2' starting 'in-barrier' execution. 2023-07-25 16:11:36,551 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,553 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,553 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_2' received 'reached' from coordinator. 2023-07-25 16:11:36,553 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,553 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-25 16:11:36,555 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-25 16:11:36,555 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-25 16:11:36,555 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:36,555 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. started... 2023-07-25 16:11:36,556 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a40a6cc2a33af663d9cc72cadf80c7cc: 2023-07-25 16:11:36,556 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc.' region-info for snapshot=hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,556 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-25 16:11:36,556 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/33eea152adc9498b870450eb9f0af40f, hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/fac333f4810c4c80a60d79315caf2bc6] hfiles 2023-07-25 16:11:36,556 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/33eea152adc9498b870450eb9f0af40f for snapshot=hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,556 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/x/fac333f4810c4c80a60d79315caf2bc6 for snapshot=hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,556 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-25 16:11:36,875 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-25 16:11:36,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-25 16:11:36,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-25 16:11:36,878 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-25 16:11:36,957 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-25 16:11:36,979 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. completed. 2023-07-25 16:11:36,979 DEBUG [rs(jenkins-hbase6.apache.org,44091,1690301479338)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:11:36,979 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-25 16:11:36,979 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-25 16:11:36,980 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,980 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_2' locally completed 2023-07-25 16:11:36,980 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_2' completed for member 'jenkins-hbase6.apache.org,44091,1690301479338' in zk 2023-07-25 16:11:36,986 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,986 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_2' has notified controller of completion 2023-07-25 16:11:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-25 16:11:36,986 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-25 16:11:36,986 DEBUG [member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_2' completed. 2023-07-25 16:11:36,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_2' member 'jenkins-hbase6.apache.org,44091,1690301479338': 2023-07-25 16:11:36,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44091,1690301479338' released barrier for procedure'hbase_shell_quota_tests_table_2', counting down latch. Waiting for 0 more 2023-07-25 16:11:36,992 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_2' execution completed 2023-07-25 16:11:36,992 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-25 16:11:36,992 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-25 16:11:36,992 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,992 INFO [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_2including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-25 16:11:36,994 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,994 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,994 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-25 16:11:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-25 16:11:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-25 16:11:36,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-25 16:11:36,995 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-25 16:11:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-25 16:11:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-25 16:11:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,998 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-25 16:11:36,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-25 16:11:36,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:37,001 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:37,001 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,001 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,001 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:11:37,001 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,001 DEBUG [(jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-25 16:11:37,001 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,001 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,001 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-25 16:11:37,002 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 because node does not exist (not an error) 2023-07-25 16:11:37,002 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-25 16:11:37,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-25 16:11:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-25 16:11:37,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-25 16:11:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-25 16:11:37,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 to hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,628 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-25 16:11:37,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-25 16:11:37,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-25 16:11:37,630 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2428): (#4) Sleeping: 1250ms while waiting for snapshot completion. 2023-07-25 16:11:37,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed 2023-07-25 16:11:37,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,895 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-25 16:11:37,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1690301496121Consolidate snapshot: hbase_shell_quota_tests_table_2 at 1690301497002 (+881 ms)Loading Region manifests for hbase_shell_quota_tests_table_2 at 1690301497002Writing data manifest for hbase_shell_quota_tests_table_2 at 1690301497007 (+5 ms)Verifying snapshot: hbase_shell_quota_tests_table_2 at 1690301497418 (+411 ms)Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed at 1690301497894 (+476 ms) 2023-07-25 16:11:37,896 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=24, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-25 16:11:37,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 1.7750 sec 2023-07-25 16:11:38,881 DEBUG [Listener at localhost/35987] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-25 16:11:38,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-25 16:11:38,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 2.7916 seconds 2023-07-25 16:13:38,541 DEBUG [master/jenkins-hbase6:0.Chore.1] quotas.QuotaObserverChore(336): hbase_shell_quota_tests_table moved into observance of table space quota. 2023-07-25 16:16:19,355 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache(965): totalSize=587.81 KB, freeSize=781.83 MB, max=782.40 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2023-07-25 16:16:19,596 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): data stats (chunk size=2097152): current pool size=1, created chunk count=9, reused chunk count=1, reuseRatio=10.00% 2023-07-25 16:16:19,597 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2023-07-25 16:16:21,004 INFO [jenkins-hbase6:44091Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-25 16:16:22,345 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(200): Skipping table hbase_shell_quota_tests_table because normalization is disabled in its table properties and normalization is also disabled at table level by default 2023-07-25 16:16:22,346 DEBUG [master/jenkins-hbase6:0.Chore.1] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster. 2023-07-25 16:16:22,346 DEBUG [master/jenkins-hbase6:0.Chore.1] master.HMaster(1882): Balancer is going into sleep until next period in 300000ms 2023-07-25 16:16:22,353 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-25 16:16:23,009 INFO [regionserver/jenkins-hbase6:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because 1588230740/info has an old edit so flush to free WALs after random delay 143572 ms 2023-07-25 16:16:23,967 INFO [regionserver/jenkins-hbase6:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. because 7353e2baf07009b6c574276304929634/info has an old edit so flush to free WALs after random delay 239982 ms 2023-07-25 16:16:26,966 INFO [regionserver/jenkins-hbase6:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. because 138beb39ba785bfbe1f63b99c3a28d17/l has an old edit so flush to free WALs after random delay 12419 ms 2023-07-25 16:16:26,967 INFO [regionserver/jenkins-hbase6:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. because 1c8d3a3854b656fdfce8780aecf9c375/f has an old edit so flush to free WALs after random delay 175722 ms 2023-07-25 16:16:27,630 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-25 16:16:33,031 INFO [regionserver/jenkins-hbase6:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. because 2066fced79ac7b208e1db37ceb4d8952/q has an old edit so flush to free WALs after random delay 77748 ms 2023-07-25 16:16:33,180 DEBUG [regionserver/jenkins-hbase6:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:16:33,182 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:41984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2023-07-25 16:16:39,386 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 138beb39ba785bfbe1f63b99c3a28d17 1/1 column families, dataSize=113 B heapSize=520 B 2023-07-25 16:16:39,404 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=113 B at sequenceid=6 (bloomFilter=false), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17/.tmp/l/e0ee13fb1f0d4e63bf267556f2fa2806 2023-07-25 16:16:39,411 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17/.tmp/l/e0ee13fb1f0d4e63bf267556f2fa2806 as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17/l/e0ee13fb1f0d4e63bf267556f2fa2806 2023-07-25 16:16:39,417 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17/l/e0ee13fb1f0d4e63bf267556f2fa2806, entries=2, sequenceid=6, filesize=4.7 K 2023-07-25 16:16:39,419 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~113 B/113, heapSize ~504 B/504, currentSize=0 B/0 for 138beb39ba785bfbe1f63b99c3a28d17 in 33ms, sequenceid=6, compaction requested=false 2023-07-25 16:16:39,419 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 138beb39ba785bfbe1f63b99c3a28d17: 2023-07-25 16:17:23,630 DEBUG [master/jenkins-hbase6:0.Chore.1] zookeeper.ReadOnlyZKClient(139): Connect 0x1db096c2 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:23,635 DEBUG [master/jenkins-hbase6:0.Chore.1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21903862, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:23,636 DEBUG [hconnection-0x2f6f3fcd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:23,637 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:17:24,209 INFO [Listener at localhost/35987] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:17:24,210 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cc3d08f to 127.0.0.1:62218 2023-07-25 16:17:24,210 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,214 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x5adff7c4 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,227 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@499a7206, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,229 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,231 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:17:24,238 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5adff7c4 to 127.0.0.1:62218 2023-07-25 16:17:24,238 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,243 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x1680dbb8 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,251 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3784805e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,253 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,255 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:17:24,259 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1680dbb8 to 127.0.0.1:62218 2023-07-25 16:17:24,260 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,261 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x4a22125e to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,265 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1670ccb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,267 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,268 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:17:24,272 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a22125e to 127.0.0.1:62218 2023-07-25 16:17:24,272 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,273 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x3e9b82a7 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,282 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64565471, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,284 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,285 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0100 seconds Took 0.0009 seconds Took 0.0009 seconds Took 0.0009 seconds Took 0.0008 seconds Took 0.0009 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0009 seconds 2023-07-25 16:17:24,326 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e9b82a7 to 127.0.0.1:62218 2023-07-25 16:17:24,326 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,328 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x5c7a982c to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,334 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@104cef7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,336 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,338 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0008 seconds 2023-07-25 16:17:24,344 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c7a982c to 127.0.0.1:62218 2023-07-25 16:17:24,345 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,346 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x2ec42b80 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,350 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3348553, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,352 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,354 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0010 seconds 2023-07-25 16:17:24,359 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ec42b80 to 127.0.0.1:62218 2023-07-25 16:17:24,360 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,363 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x0310aa1b to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,368 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67296cb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,371 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,372 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0013 seconds 2023-07-25 16:17:24,377 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0310aa1b to 127.0.0.1:62218 2023-07-25 16:17:24,378 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,379 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x6c133cea to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,390 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73ee1572, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,392 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,394 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:17:24,397 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:17:24,399 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0061 seconds 2023-07-25 16:17:24,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] quotas.MasterQuotaManager(451): Client=jenkins//172.31.2.20 switch exceed throttle quota from false to true 2023-07-25 16:17:24,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] quotas.MasterQuotaManager(451): Client=jenkins//172.31.2.20 switch exceed throttle quota from true to false Took 0.0031 seconds 2023-07-25 16:17:24,420 INFO [Listener at localhost/35987] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:17:24,421 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c133cea to 127.0.0.1:62218 2023-07-25 16:17:24,421 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,422 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x628b7b3d to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,427 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@381d7706, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,428 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,430 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-25 16:17:24,434 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-25 16:17:24,436 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-25 16:17:24,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] zookeeper.ZKUtil(398): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-25 16:17:24,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] quotas.MasterQuotaManager(399): Client=jenkins//172.31.2.20 switch rpc throttle from true to false 2023-07-25 16:17:24,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] procedure2.ProcedureExecutor(1029): Stored pid=25, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase6.apache.org,35973,1690301477364, rpcThrottleEnabled=false 2023-07-25 16:17:24,452 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:17:24,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase6.apache.org,44091,1690301479338, rpcThrottleEnabled=false}] 2023-07-25 16:17:24,612 DEBUG [RSProcedureDispatcher-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-25 16:17:24,613 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-25 16:17:24,614 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44091] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=26 2023-07-25 16:17:24,616 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from true to false 2023-07-25 16:17:24,618 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=26 2023-07-25 16:17:24,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35973] master.HMaster(3641): Remote procedure done, pid=26 2023-07-25 16:17:24,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=25 2023-07-25 16:17:24,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=25, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase6.apache.org,44091,1690301479338, rpcThrottleEnabled=false in 169 msec 2023-07-25 16:17:24,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase6.apache.org,35973,1690301477364, rpcThrottleEnabled=false in 183 msec 2023-07-25 16:17:24,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] quotas.MasterQuotaManager(399): Client=jenkins//172.31.2.20 switch rpc throttle from false to true 2023-07-25 16:17:24,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35973] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase6.apache.org,35973,1690301477364, rpcThrottleEnabled=true 2023-07-25 16:17:24,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase6.apache.org,44091,1690301479338, rpcThrottleEnabled=true}] 2023-07-25 16:17:24,784 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44091] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=28 2023-07-25 16:17:24,785 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from false to true 2023-07-25 16:17:24,785 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=28 2023-07-25 16:17:24,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35973] master.HMaster(3641): Remote procedure done, pid=28 2023-07-25 16:17:24,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-25 16:17:24,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase6.apache.org,44091,1690301479338, rpcThrottleEnabled=true in 154 msec 2023-07-25 16:17:24,790 INFO [Listener at localhost/35987] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:17:24,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase6.apache.org,35973,1690301477364, rpcThrottleEnabled=true in 161 msec 2023-07-25 16:17:24,790 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x628b7b3d to 127.0.0.1:62218 2023-07-25 16:17:24,791 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-25 16:17:24,793 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(139): Connect 0x11bd0169 to 127.0.0.1:62218 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-25 16:17:24,797 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a11fbd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-25 16:17:24,800 DEBUG [Listener at localhost/35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-25 16:17:24,801 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0011 seconds 2023-07-25 16:17:24,807 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11bd0169 to 127.0.0.1:62218 2023-07-25 16:17:24,807 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client . Finished in 354.329888 seconds. ------------------------------------------------------------------------------- 16 tests, 62 assertions, 0 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications 100% passed ------------------------------------------------------------------------------- 0.05 tests/s, 0.17 assertions/s Done with tests! Shutting down the cluster... 2023-07-25 16:17:24,829 INFO [Listener at localhost/35987] hbase.ResourceChecker(175): after: client.TestQuotasShell#testRunShellTests Thread=268 (was 237) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x11bd0169-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: Ruby-0-JIT-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x11bd0169 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/411118205.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f6f3fcd-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x1db096c2-SendThread(127.0.0.1:62218) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x5d3e72a2-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x0310aa1b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1988136776_17 at /127.0.0.1:54340 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x2ec42b80-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x1db096c2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/411118205.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x5c7a982c java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/411118205.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x628b7b3d-SendThread(127.0.0.1:62218) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: hconnection-0x5d3e72a2-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x5c7a982c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x5d3e72a2-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x11bd0169-SendThread(127.0.0.1:62218) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x5c7a982c-SendThread(127.0.0.1:62218) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x1db096c2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x2f6f3fcd-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d3e72a2-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jnr.ffi.util.ref.internal.Finalizer java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) jnr.ffi.util.ref.internal.Finalizer.run(Finalizer.java:180) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x628b7b3d java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/411118205.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x0310aa1b java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/411118205.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x2ec42b80 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/411118205.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase6.apache.org,44091,1690301479338' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x628b7b3d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x0310aa1b-SendThread(127.0.0.1:62218) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62218@0x2ec42b80-SendThread(127.0.0.1:62218) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,35973,1690301477364)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=493 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=64 (was 225), ProcessCount=167 (was 173), AvailableMemoryMB=251 (was 1780) 2023-07-25 16:17:24,830 INFO [Listener at localhost/35987] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-25 16:17:24,830 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x760bf804 to 127.0.0.1:62218 2023-07-25 16:17:24,831 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:17:24,831 DEBUG [Listener at localhost/35987] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-25 16:17:24,831 DEBUG [Listener at localhost/35987] util.JVMClusterUtil(257): Found active master hash=1852589903, stopped=false 2023-07-25 16:17:24,831 DEBUG [Listener at localhost/35987] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:17:24,832 DEBUG [Listener at localhost/35987] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-25 16:17:24,832 DEBUG [Listener at localhost/35987] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:17:24,832 DEBUG [Listener at localhost/35987] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-25 16:17:24,832 INFO [Listener at localhost/35987] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:17:24,833 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-25 16:17:24,834 INFO [Listener at localhost/35987] procedure2.ProcedureExecutor(629): Stopping 2023-07-25 16:17:24,833 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-25 16:17:24,834 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:17:24,834 DEBUG [Listener at localhost/35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79000ed5 to 127.0.0.1:62218 2023-07-25 16:17:24,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-25 16:17:24,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-25 16:17:24,834 DEBUG [Listener at localhost/35987] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:17:24,834 INFO [Listener at localhost/35987] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase6.apache.org,44091,1690301479338' ***** 2023-07-25 16:17:24,835 DEBUG [Listener at localhost/35987] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:17:24,835 INFO [Listener at localhost/35987] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-25 16:17:24,835 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-25 16:17:24,844 INFO [RS:0;jenkins-hbase6:44091] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@72f28dfc{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-25 16:17:24,848 INFO [RS:0;jenkins-hbase6:44091] server.AbstractConnector(383): Stopped ServerConnector@21a16fa5{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-25 16:17:24,848 INFO [RS:0;jenkins-hbase6:44091] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-25 16:17:24,849 INFO [RS:0;jenkins-hbase6:44091] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@5ea7b6c3{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-25 16:17:24,849 INFO [RS:0;jenkins-hbase6:44091] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@41f33dc0{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/hadoop.log.dir/,STOPPED} 2023-07-25 16:17:24,851 INFO [RS:0;jenkins-hbase6:44091] regionserver.HeapMemoryManager(220): Stopping 2023-07-25 16:17:24,852 INFO [RS:0;jenkins-hbase6:44091] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-25 16:17:24,852 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-25 16:17:24,852 INFO [RS:0;jenkins-hbase6:44091] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-25 16:17:24,852 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(3305): Received CLOSE for 2066fced79ac7b208e1db37ceb4d8952 2023-07-25 16:17:24,853 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(3305): Received CLOSE for 138beb39ba785bfbe1f63b99c3a28d17 2023-07-25 16:17:24,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 2066fced79ac7b208e1db37ceb4d8952, disabling compactions & flushes 2023-07-25 16:17:24,853 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(3305): Received CLOSE for 1c8d3a3854b656fdfce8780aecf9c375 2023-07-25 16:17:24,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:17:24,853 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(3305): Received CLOSE for a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:17:24,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:17:24,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. after waiting 0 ms 2023-07-25 16:17:24,853 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(3305): Received CLOSE for 7353e2baf07009b6c574276304929634 2023-07-25 16:17:24,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:17:24,854 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1144): stopping server jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:17:24,854 INFO [RS:0;jenkins-hbase6:44091] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-25 16:17:24,854 DEBUG [RS:0;jenkins-hbase6:44091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12782a75 to 127.0.0.1:62218 2023-07-25 16:17:24,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 2066fced79ac7b208e1db37ceb4d8952 2/2 column families, dataSize=1.31 KB heapSize=3.84 KB 2023-07-25 16:17:24,854 DEBUG [RS:0;jenkins-hbase6:44091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:17:24,855 INFO [RS:0;jenkins-hbase6:44091] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-25 16:17:24,855 INFO [RS:0;jenkins-hbase6:44091] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-25 16:17:24,855 INFO [RS:0;jenkins-hbase6:44091] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-25 16:17:24,855 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-25 16:17:24,855 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1474): Waiting on 6 regions to close 2023-07-25 16:17:24,855 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1478): Online Regions={2066fced79ac7b208e1db37ceb4d8952=hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952., 138beb39ba785bfbe1f63b99c3a28d17=hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17., 1c8d3a3854b656fdfce8780aecf9c375=hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375., a40a6cc2a33af663d9cc72cadf80c7cc=hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc., 1588230740=hbase:meta,,1.1588230740, 7353e2baf07009b6c574276304929634=hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.} 2023-07-25 16:17:24,856 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 138beb39ba785bfbe1f63b99c3a28d17, 1588230740, 1c8d3a3854b656fdfce8780aecf9c375, 2066fced79ac7b208e1db37ceb4d8952, 7353e2baf07009b6c574276304929634, a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:17:24,856 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-25 16:17:24,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-25 16:17:24,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-25 16:17:24,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-25 16:17:24,857 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-25 16:17:24,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=6.34 KB heapSize=11.52 KB 2023-07-25 16:17:24,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.88 KB at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/.tmp/info/d3c6f12f21d34a4f97daa1978f242492 2023-07-25 16:17:24,891 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-25 16:17:24,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=472 B at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/.tmp/table/1ebcec28b432488cbcf092cd4a24a80a 2023-07-25 16:17:24,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/.tmp/info/d3c6f12f21d34a4f97daa1978f242492 as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/info/d3c6f12f21d34a4f97daa1978f242492 2023-07-25 16:17:24,921 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/info/d3c6f12f21d34a4f97daa1978f242492, entries=50, sequenceid=29, filesize=10.6 K 2023-07-25 16:17:24,922 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/.tmp/table/1ebcec28b432488cbcf092cd4a24a80a as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/table/1ebcec28b432488cbcf092cd4a24a80a 2023-07-25 16:17:24,929 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/table/1ebcec28b432488cbcf092cd4a24a80a, entries=10, sequenceid=29, filesize=5.1 K 2023-07-25 16:17:24,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~6.34 KB/6489, heapSize ~11.23 KB/11504, currentSize=0 B/0 for 1588230740 in 73ms, sequenceid=29, compaction requested=false 2023-07-25 16:17:24,937 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/meta/1588230740/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-25 16:17:24,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:17:24,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-25 16:17:24,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:17:24,939 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-25 16:17:24,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-25 16:17:24,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-25 16:17:24,966 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-25 16:17:24,967 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-25 16:17:25,057 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 138beb39ba785bfbe1f63b99c3a28d17, 1c8d3a3854b656fdfce8780aecf9c375, 2066fced79ac7b208e1db37ceb4d8952, 7353e2baf07009b6c574276304929634, a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:17:25,257 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 138beb39ba785bfbe1f63b99c3a28d17, 1c8d3a3854b656fdfce8780aecf9c375, 2066fced79ac7b208e1db37ceb4d8952, 7353e2baf07009b6c574276304929634, a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:17:25,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=830 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/.tmp/q/9eb772ceb77c4d0895400a1b2927f049 2023-07-25 16:17:25,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9eb772ceb77c4d0895400a1b2927f049 2023-07-25 16:17:25,457 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 138beb39ba785bfbe1f63b99c3a28d17, 1c8d3a3854b656fdfce8780aecf9c375, 2066fced79ac7b208e1db37ceb4d8952, 7353e2baf07009b6c574276304929634, a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:17:25,657 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 138beb39ba785bfbe1f63b99c3a28d17, 1c8d3a3854b656fdfce8780aecf9c375, 2066fced79ac7b208e1db37ceb4d8952, 7353e2baf07009b6c574276304929634, a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:17:25,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=510 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/.tmp/u/ff86408219274b549546999102481d01 2023-07-25 16:17:25,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff86408219274b549546999102481d01 2023-07-25 16:17:25,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/.tmp/q/9eb772ceb77c4d0895400a1b2927f049 as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/q/9eb772ceb77c4d0895400a1b2927f049 2023-07-25 16:17:25,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9eb772ceb77c4d0895400a1b2927f049 2023-07-25 16:17:25,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/q/9eb772ceb77c4d0895400a1b2927f049, entries=8, sequenceid=24, filesize=5.2 K 2023-07-25 16:17:25,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/.tmp/u/ff86408219274b549546999102481d01 as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/u/ff86408219274b549546999102481d01 2023-07-25 16:17:25,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff86408219274b549546999102481d01 2023-07-25 16:17:25,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/u/ff86408219274b549546999102481d01, entries=10, sequenceid=24, filesize=5.4 K 2023-07-25 16:17:25,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.31 KB/1340, heapSize ~3.80 KB/3896, currentSize=0 B/0 for 2066fced79ac7b208e1db37ceb4d8952 in 879ms, sequenceid=24, compaction requested=false 2023-07-25 16:17:25,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/quota/2066fced79ac7b208e1db37ceb4d8952/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-25 16:17:25,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:17:25,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:17:25,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:17:25,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 2066fced79ac7b208e1db37ceb4d8952: 2023-07-25 16:17:25,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1690301483502.2066fced79ac7b208e1db37ceb4d8952. 2023-07-25 16:17:25,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 138beb39ba785bfbe1f63b99c3a28d17, disabling compactions & flushes 2023-07-25 16:17:25,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:17:25,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:17:25,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. after waiting 0 ms 2023-07-25 16:17:25,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:17:25,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/acl/138beb39ba785bfbe1f63b99c3a28d17/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-25 16:17:25,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:17:25,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:17:25,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:17:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 138beb39ba785bfbe1f63b99c3a28d17: 2023-07-25 16:17:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690301483566.138beb39ba785bfbe1f63b99c3a28d17. 2023-07-25 16:17:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 1c8d3a3854b656fdfce8780aecf9c375, disabling compactions & flushes 2023-07-25 16:17:25,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:17:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:17:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. after waiting 0 ms 2023-07-25 16:17:25,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:17:25,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 1c8d3a3854b656fdfce8780aecf9c375 1/1 column families, dataSize=32 B heapSize=360 B 2023-07-25 16:17:25,858 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-25 16:17:25,858 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1478): Online Regions={1c8d3a3854b656fdfce8780aecf9c375=hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375., a40a6cc2a33af663d9cc72cadf80c7cc=hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc., 7353e2baf07009b6c574276304929634=hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634.} 2023-07-25 16:17:25,858 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 1c8d3a3854b656fdfce8780aecf9c375, 7353e2baf07009b6c574276304929634, a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:17:26,058 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 1c8d3a3854b656fdfce8780aecf9c375, 7353e2baf07009b6c574276304929634, a40a6cc2a33af663d9cc72cadf80c7cc 2023-07-25 16:17:26,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32 B at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375/.tmp/f/9af149412066446a9494042ab883232d 2023-07-25 16:17:26,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375/.tmp/f/9af149412066446a9494042ab883232d as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375/f/9af149412066446a9494042ab883232d 2023-07-25 16:17:26,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375/f/9af149412066446a9494042ab883232d, entries=1, sequenceid=4, filesize=4.6 K 2023-07-25 16:17:26,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32 B/32, heapSize ~344 B/344, currentSize=0 B/0 for 1c8d3a3854b656fdfce8780aecf9c375 in 424ms, sequenceid=4, compaction requested=false 2023-07-25 16:17:26,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/labels/1c8d3a3854b656fdfce8780aecf9c375/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=1 2023-07-25 16:17:26,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:17:26,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:17:26,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:17:26,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 1c8d3a3854b656fdfce8780aecf9c375: 2023-07-25 16:17:26,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:labels,,1690301485108.1c8d3a3854b656fdfce8780aecf9c375. 2023-07-25 16:17:26,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing a40a6cc2a33af663d9cc72cadf80c7cc, disabling compactions & flushes 2023-07-25 16:17:26,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:17:26,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:17:26,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. after waiting 0 ms 2023-07-25 16:17:26,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:17:26,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/default/hbase_shell_quota_tests_table/a40a6cc2a33af663d9cc72cadf80c7cc/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-25 16:17:26,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:17:26,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:17:26,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:17:26,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for a40a6cc2a33af663d9cc72cadf80c7cc: 2023-07-25 16:17:26,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase_shell_quota_tests_table,,1690301490608.a40a6cc2a33af663d9cc72cadf80c7cc. 2023-07-25 16:17:26,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 7353e2baf07009b6c574276304929634, disabling compactions & flushes 2023-07-25 16:17:26,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:17:26,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:17:26,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. after waiting 0 ms 2023-07-25 16:17:26,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:17:26,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 7353e2baf07009b6c574276304929634 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-25 16:17:26,258 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 7353e2baf07009b6c574276304929634 2023-07-25 16:17:26,458 DEBUG [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1504): Waiting on 7353e2baf07009b6c574276304929634 2023-07-25 16:17:26,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634/.tmp/info/f48110f60ef341de9648064cefeb051d 2023-07-25 16:17:26,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634/.tmp/info/f48110f60ef341de9648064cefeb051d as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634/info/f48110f60ef341de9648064cefeb051d 2023-07-25 16:17:26,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634/info/f48110f60ef341de9648064cefeb051d, entries=2, sequenceid=6, filesize=4.8 K 2023-07-25 16:17:26,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7353e2baf07009b6c574276304929634 in 426ms, sequenceid=6, compaction requested=false 2023-07-25 16:17:26,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/data/hbase/namespace/7353e2baf07009b6c574276304929634/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-25 16:17:26,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-25 16:17:26,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-25 16:17:26,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:17:26,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 7353e2baf07009b6c574276304929634: 2023-07-25 16:17:26,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690301482358.7353e2baf07009b6c574276304929634. 2023-07-25 16:17:26,659 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1170): stopping server jenkins-hbase6.apache.org,44091,1690301479338; all regions closed. 2023-07-25 16:17:26,659 DEBUG [RS:0;jenkins-hbase6:44091] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-25 16:17:26,671 DEBUG [RS:0;jenkins-hbase6:44091] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/oldWALs 2023-07-25 16:17:26,671 INFO [RS:0;jenkins-hbase6:44091] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44091%2C1690301479338.meta:.meta(num 1690301482043) 2023-07-25 16:17:26,678 DEBUG [RS:0;jenkins-hbase6:44091] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/oldWALs 2023-07-25 16:17:26,678 INFO [RS:0;jenkins-hbase6:44091] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44091%2C1690301479338:(num 1690301481125) 2023-07-25 16:17:26,678 DEBUG [RS:0;jenkins-hbase6:44091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:17:26,678 INFO [RS:0;jenkins-hbase6:44091] regionserver.LeaseManager(133): Closed leases 2023-07-25 16:17:26,679 INFO [RS:0;jenkins-hbase6:44091] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-25 16:17:26,679 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-25 16:17:26,680 INFO [RS:0;jenkins-hbase6:44091] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44091 2023-07-25 16:17:26,691 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-25 16:17:26,691 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44091,1690301479338 2023-07-25 16:17:26,691 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-25 16:17:26,692 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44091,1690301479338] 2023-07-25 16:17:26,692 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44091,1690301479338; numProcessing=1 2023-07-25 16:17:26,694 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44091,1690301479338 already deleted, retry=false 2023-07-25 16:17:26,694 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44091,1690301479338 expired; onlineServers=0 2023-07-25 16:17:26,694 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase6.apache.org,35973,1690301477364' ***** 2023-07-25 16:17:26,694 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-25 16:17:26,695 DEBUG [M:0;jenkins-hbase6:35973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f514d74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-07-25 16:17:26,695 INFO [M:0;jenkins-hbase6:35973] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-25 16:17:26,701 INFO [M:0;jenkins-hbase6:35973] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@7b2b3236{master,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-25 16:17:26,702 INFO [M:0;jenkins-hbase6:35973] server.AbstractConnector(383): Stopped ServerConnector@3c41a27b{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-25 16:17:26,702 INFO [M:0;jenkins-hbase6:35973] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-25 16:17:26,702 INFO [M:0;jenkins-hbase6:35973] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@526153ee{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-25 16:17:26,703 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-25 16:17:26,703 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-25 16:17:26,703 INFO [M:0;jenkins-hbase6:35973] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@32a929fb{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/hadoop.log.dir/,STOPPED} 2023-07-25 16:17:26,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-25 16:17:26,704 INFO [M:0;jenkins-hbase6:35973] regionserver.HRegionServer(1144): stopping server jenkins-hbase6.apache.org,35973,1690301477364 2023-07-25 16:17:26,704 INFO [M:0;jenkins-hbase6:35973] regionserver.HRegionServer(1170): stopping server jenkins-hbase6.apache.org,35973,1690301477364; all regions closed. 2023-07-25 16:17:26,704 DEBUG [M:0;jenkins-hbase6:35973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-25 16:17:26,704 INFO [M:0;jenkins-hbase6:35973] master.HMaster(1491): Stopping master jetty server 2023-07-25 16:17:26,705 INFO [M:0;jenkins-hbase6:35973] server.AbstractConnector(383): Stopped ServerConnector@c58d32d{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-25 16:17:26,705 DEBUG [M:0;jenkins-hbase6:35973] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-25 16:17:26,705 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-25 16:17:26,705 DEBUG [M:0;jenkins-hbase6:35973] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-25 16:17:26,705 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1690301480779] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1690301480779,5,FailOnTimeoutGroup] 2023-07-25 16:17:26,705 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1690301480778] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1690301480778,5,FailOnTimeoutGroup] 2023-07-25 16:17:26,705 INFO [M:0;jenkins-hbase6:35973] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-25 16:17:26,706 INFO [M:0;jenkins-hbase6:35973] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-25 16:17:26,706 INFO [M:0;jenkins-hbase6:35973] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2023-07-25 16:17:26,706 DEBUG [M:0;jenkins-hbase6:35973] master.HMaster(1512): Stopping service threads 2023-07-25 16:17:26,706 INFO [M:0;jenkins-hbase6:35973] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-25 16:17:26,707 INFO [M:0;jenkins-hbase6:35973] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-25 16:17:26,707 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-25 16:17:26,708 DEBUG [M:0;jenkins-hbase6:35973] zookeeper.ZKUtil(398): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-25 16:17:26,708 WARN [M:0;jenkins-hbase6:35973] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-25 16:17:26,708 INFO [M:0;jenkins-hbase6:35973] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-25 16:17:26,708 INFO [M:0;jenkins-hbase6:35973] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-25 16:17:26,708 DEBUG [M:0;jenkins-hbase6:35973] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-25 16:17:26,708 INFO [M:0;jenkins-hbase6:35973] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-25 16:17:26,708 DEBUG [M:0;jenkins-hbase6:35973] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-25 16:17:26,708 DEBUG [M:0;jenkins-hbase6:35973] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-25 16:17:26,708 DEBUG [M:0;jenkins-hbase6:35973] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-25 16:17:26,709 INFO [M:0;jenkins-hbase6:35973] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=95.72 KB heapSize=115.64 KB 2023-07-25 16:17:26,721 INFO [M:0;jenkins-hbase6:35973] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=95.72 KB at sequenceid=237 (bloomFilter=true), to=hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7100c26fb06d49869e84a612a6da07dd 2023-07-25 16:17:26,727 INFO [M:0;jenkins-hbase6:35973] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7100c26fb06d49869e84a612a6da07dd 2023-07-25 16:17:26,728 DEBUG [M:0;jenkins-hbase6:35973] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7100c26fb06d49869e84a612a6da07dd as hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7100c26fb06d49869e84a612a6da07dd 2023-07-25 16:17:26,735 INFO [M:0;jenkins-hbase6:35973] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7100c26fb06d49869e84a612a6da07dd 2023-07-25 16:17:26,735 INFO [M:0;jenkins-hbase6:35973] regionserver.HStore(1080): Added hdfs://localhost:33025/user/jenkins/test-data/b88faff2-93b0-a4f2-4c77-8eeea6599a00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7100c26fb06d49869e84a612a6da07dd, entries=28, sequenceid=237, filesize=7.7 K 2023-07-25 16:17:26,736 INFO [M:0;jenkins-hbase6:35973] regionserver.HRegion(2948): Finished flush of dataSize ~95.72 KB/98014, heapSize ~115.63 KB/118400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=237, compaction requested=false 2023-07-25 16:17:26,737 INFO [M:0;jenkins-hbase6:35973] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-25 16:17:26,737 DEBUG [M:0;jenkins-hbase6:35973] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-25 16:17:26,740 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-25 16:17:26,740 INFO [M:0;jenkins-hbase6:35973] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-25 16:17:26,741 INFO [M:0;jenkins-hbase6:35973] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:35973 2023-07-25 16:17:26,742 DEBUG [M:0;jenkins-hbase6:35973] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,35973,1690301477364 already deleted, retry=false 2023-07-25 16:17:26,794 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-25 16:17:26,794 INFO [RS:0;jenkins-hbase6:44091] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase6.apache.org,44091,1690301479338; zookeeper connection closed. 2023-07-25 16:17:26,794 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): regionserver:44091-0x100c4cbab1b0001, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-25 16:17:26,794 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3c134cda] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3c134cda 2023-07-25 16:17:26,794 INFO [Listener at localhost/35987] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-25 16:17:26,894 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-25 16:17:26,894 INFO [M:0;jenkins-hbase6:35973] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase6.apache.org,35973,1690301477364; zookeeper connection closed. 2023-07-25 16:17:26,894 DEBUG [Listener at localhost/35987-EventThread] zookeeper.ZKWatcher(600): master:35973-0x100c4cbab1b0000, quorum=127.0.0.1:62218, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-25 16:17:26,895 WARN [Listener at localhost/35987] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-25 16:17:26,898 INFO [Listener at localhost/35987] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-25 16:17:27,002 WARN [BP-2013759371-172.31.2.20-1690301474081 heartbeating to localhost/127.0.0.1:33025] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-25 16:17:27,003 WARN [BP-2013759371-172.31.2.20-1690301474081 heartbeating to localhost/127.0.0.1:33025] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2013759371-172.31.2.20-1690301474081 (Datanode Uuid dba5feea-b226-4375-8907-17c1b166309f) service to localhost/127.0.0.1:33025 2023-07-25 16:17:27,004 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/cluster_6898d65f-5d8b-715b-1e6a-a8440fdb338e/dfs/data/data1/current/BP-2013759371-172.31.2.20-1690301474081] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-25 16:17:27,005 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/55ead15d-0130-6f1e-a779-cff04194f1d1/cluster_6898d65f-5d8b-715b-1e6a-a8440fdb338e/dfs/data/data2/current/BP-2013759371-172.31.2.20-1690301474081] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-25 16:17:27,044 INFO [Listener at localhost/35987] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-25 16:17:27,154 INFO [Listener at localhost/35987] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-25 16:17:27,186 INFO [Listener at localhost/35987] hbase.HBaseTestingUtility(1293): Minicluster is down