2023-07-15 16:21:43,934 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5 2023-07-15 16:21:44,053 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestQuotasShell timeout: 13 mins 2023-07-15 16:21:44,185 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 16:21:44,303 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 16:21:44,303 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/cluster_edbdb1ca-a970-1c74-ea26-003d07cff7d0, deleteOnExit=true 2023-07-15 16:21:44,303 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 16:21:44,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/test.cache.data in system properties and HBase conf 2023-07-15 16:21:44,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 16:21:44,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/hadoop.log.dir in system properties and HBase conf 2023-07-15 16:21:44,305 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 16:21:44,305 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 16:21:44,305 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 16:21:44,635 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 16:21:44,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:21:44,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:21:44,641 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 16:21:44,641 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:21:44,641 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 16:21:44,642 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 16:21:44,642 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:21:44,642 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:21:44,642 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 16:21:44,643 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/nfs.dump.dir in system properties and HBase conf 2023-07-15 16:21:44,643 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/java.io.tmpdir in system properties and HBase conf 2023-07-15 16:21:44,643 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:21:44,643 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 16:21:44,644 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 16:21:45,170 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 16:21:45,175 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 16:21:45,485 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 16:21:45,652 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 16:21:45,705 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:21:45,747 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:21:45,782 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/java.io.tmpdir/Jetty_localhost_35973_hdfs____zceuhp/webapp 2023-07-15 16:21:45,910 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35973 2023-07-15 16:21:45,920 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 16:21:45,920 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 16:21:46,410 WARN [Listener at localhost/39495] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:21:46,563 WARN [Listener at localhost/39495] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 16:21:46,582 WARN [Listener at localhost/39495] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:21:46,590 INFO [Listener at localhost/39495] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:21:46,599 INFO [Listener at localhost/39495] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/java.io.tmpdir/Jetty_localhost_36123_datanode____4s65hy/webapp 2023-07-15 16:21:46,713 INFO [Listener at localhost/39495] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36123 2023-07-15 16:21:46,907 WARN [Listener at localhost/41149] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:21:47,372 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae2deeba7a28b5dd: Processing first storage report for DS-7001114a-0635-4c88-9f0c-83896a13df32 from datanode 27f5a0f1-7325-4d4d-a42d-01f4cb7e3898 2023-07-15 16:21:47,373 DEBUG [Listener at localhost/41149] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5 2023-07-15 16:21:47,373 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae2deeba7a28b5dd: from storage DS-7001114a-0635-4c88-9f0c-83896a13df32 node DatanodeRegistration(127.0.0.1:32857, datanodeUuid=27f5a0f1-7325-4d4d-a42d-01f4cb7e3898, infoPort=46753, infoSecurePort=0, ipcPort=41149, storageInfo=lv=-57;cid=testClusterID;nsid=2005123095;c=1689438105259), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 16:21:47,374 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae2deeba7a28b5dd: Processing first storage report for DS-b3503e3a-d2c6-4492-a3d9-d047cba0effc from datanode 27f5a0f1-7325-4d4d-a42d-01f4cb7e3898 2023-07-15 16:21:47,374 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae2deeba7a28b5dd: from storage DS-b3503e3a-d2c6-4492-a3d9-d047cba0effc node DatanodeRegistration(127.0.0.1:32857, datanodeUuid=27f5a0f1-7325-4d4d-a42d-01f4cb7e3898, infoPort=46753, infoSecurePort=0, ipcPort=41149, storageInfo=lv=-57;cid=testClusterID;nsid=2005123095;c=1689438105259), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:21:47,447 INFO [Listener at localhost/41149] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/cluster_edbdb1ca-a970-1c74-ea26-003d07cff7d0/zookeeper_0, clientPort=52983, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/cluster_edbdb1ca-a970-1c74-ea26-003d07cff7d0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/cluster_edbdb1ca-a970-1c74-ea26-003d07cff7d0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 16:21:47,460 INFO [Listener at localhost/41149] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52983 2023-07-15 16:21:47,467 INFO [Listener at localhost/41149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:21:47,469 INFO [Listener at localhost/41149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:21:48,137 INFO [Listener at localhost/41149] util.FSUtils(471): Created version file at hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72 with version=8 2023-07-15 16:21:48,138 INFO [Listener at localhost/41149] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/hbase-staging 2023-07-15 16:21:48,154 DEBUG [Listener at localhost/41149] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-15 16:21:48,154 DEBUG [Listener at localhost/41149] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-15 16:21:48,467 INFO [Listener at localhost/41149] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 16:21:48,954 INFO [Listener at localhost/41149] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=18 2023-07-15 16:21:48,987 INFO [Listener at localhost/41149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:21:48,987 INFO [Listener at localhost/41149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:21:48,987 INFO [Listener at localhost/41149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:21:48,988 INFO [Listener at localhost/41149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:21:48,988 INFO [Listener at localhost/41149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:21:49,158 INFO [Listener at localhost/41149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:21:49,230 DEBUG [Listener at localhost/41149] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 16:21:49,323 INFO [Listener at localhost/41149] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36241 2023-07-15 16:21:49,336 INFO [Listener at localhost/41149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:21:49,339 INFO [Listener at localhost/41149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:21:49,361 INFO [Listener at localhost/41149] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36241 connecting to ZooKeeper ensemble=127.0.0.1:52983 2023-07-15 16:21:49,401 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:362410x0, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:21:49,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36241-0x10169ca3a2d0000 connected 2023-07-15 16:21:49,429 DEBUG [Listener at localhost/41149] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:21:49,430 DEBUG [Listener at localhost/41149] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:21:49,443 DEBUG [Listener at localhost/41149] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:21:49,451 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36241 2023-07-15 16:21:49,452 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36241 2023-07-15 16:21:49,452 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36241 2023-07-15 16:21:49,453 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36241 2023-07-15 16:21:49,453 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36241 2023-07-15 16:21:49,490 INFO [Listener at localhost/41149] log.Log(170): Logging initialized @6174ms to org.apache.hbase.thirdparty.org.eclipse.jetty.util.log.Slf4jLog 2023-07-15 16:21:49,634 INFO [Listener at localhost/41149] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-15 16:21:49,635 INFO [Listener at localhost/41149] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-15 16:21:49,636 INFO [Listener at localhost/41149] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-15 16:21:49,638 INFO [Listener at localhost/41149] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-15 16:21:49,638 INFO [Listener at localhost/41149] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-15 16:21:49,638 INFO [Listener at localhost/41149] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-15 16:21:49,642 INFO [Listener at localhost/41149] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-15 16:21:49,706 INFO [Listener at localhost/41149] http.HttpServer(1146): Jetty bound to port 41385 2023-07-15 16:21:49,708 INFO [Listener at localhost/41149] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-15 16:21:49,737 INFO [Listener at localhost/41149] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 16:21:49,741 INFO [Listener at localhost/41149] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2f974591{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/hadoop.log.dir/,AVAILABLE} 2023-07-15 16:21:49,741 INFO [Listener at localhost/41149] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 16:21:49,741 INFO [Listener at localhost/41149] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@1acd36c9{static,/static,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/static/,AVAILABLE} 2023-07-15 16:21:49,802 INFO [Listener at localhost/41149] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-15 16:21:49,815 INFO [Listener at localhost/41149] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-15 16:21:49,816 INFO [Listener at localhost/41149] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-15 16:21:49,818 INFO [Listener at localhost/41149] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-15 16:21:49,825 INFO [Listener at localhost/41149] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 16:21:49,851 INFO [Listener at localhost/41149] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@277157a4{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/master/,AVAILABLE}{file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/master} 2023-07-15 16:21:49,864 INFO [Listener at localhost/41149] server.AbstractConnector(333): Started ServerConnector@15a48c61{HTTP/1.1, (http/1.1)}{0.0.0.0:41385} 2023-07-15 16:21:49,865 INFO [Listener at localhost/41149] server.Server(415): Started @6549ms 2023-07-15 16:21:49,868 INFO [Listener at localhost/41149] master.HMaster(444): hbase.rootdir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72, hbase.cluster.distributed=false 2023-07-15 16:21:49,938 INFO [Listener at localhost/41149] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=18 2023-07-15 16:21:49,938 INFO [Listener at localhost/41149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:21:49,939 INFO [Listener at localhost/41149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:21:49,939 INFO [Listener at localhost/41149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:21:49,939 INFO [Listener at localhost/41149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:21:49,939 INFO [Listener at localhost/41149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:21:49,945 INFO [Listener at localhost/41149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:21:49,949 INFO [Listener at localhost/41149] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43575 2023-07-15 16:21:49,953 INFO [Listener at localhost/41149] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 16:21:49,964 DEBUG [Listener at localhost/41149] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 16:21:49,966 INFO [Listener at localhost/41149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:21:49,969 INFO [Listener at localhost/41149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:21:49,971 INFO [Listener at localhost/41149] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43575 connecting to ZooKeeper ensemble=127.0.0.1:52983 2023-07-15 16:21:49,976 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:435750x0, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:21:49,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43575-0x10169ca3a2d0001 connected 2023-07-15 16:21:49,977 DEBUG [Listener at localhost/41149] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:21:49,979 DEBUG [Listener at localhost/41149] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:21:49,980 DEBUG [Listener at localhost/41149] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:21:49,980 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43575 2023-07-15 16:21:49,982 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43575 2023-07-15 16:21:49,986 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43575 2023-07-15 16:21:49,986 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43575 2023-07-15 16:21:49,986 DEBUG [Listener at localhost/41149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43575 2023-07-15 16:21:49,989 INFO [Listener at localhost/41149] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-15 16:21:49,989 INFO [Listener at localhost/41149] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-15 16:21:49,990 INFO [Listener at localhost/41149] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-15 16:21:49,990 INFO [Listener at localhost/41149] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-15 16:21:49,990 INFO [Listener at localhost/41149] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-15 16:21:49,990 INFO [Listener at localhost/41149] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-15 16:21:49,991 INFO [Listener at localhost/41149] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-15 16:21:49,993 INFO [Listener at localhost/41149] http.HttpServer(1146): Jetty bound to port 32929 2023-07-15 16:21:49,993 INFO [Listener at localhost/41149] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-15 16:21:49,994 INFO [Listener at localhost/41149] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 16:21:49,994 INFO [Listener at localhost/41149] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@4e3578a1{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/hadoop.log.dir/,AVAILABLE} 2023-07-15 16:21:49,995 INFO [Listener at localhost/41149] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 16:21:49,995 INFO [Listener at localhost/41149] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2d65ddc4{static,/static,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/static/,AVAILABLE} 2023-07-15 16:21:50,007 INFO [Listener at localhost/41149] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-15 16:21:50,008 INFO [Listener at localhost/41149] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-15 16:21:50,008 INFO [Listener at localhost/41149] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-15 16:21:50,008 INFO [Listener at localhost/41149] session.HouseKeeper(132): node0 Scavenging every 660000ms 2023-07-15 16:21:50,009 INFO [Listener at localhost/41149] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 16:21:50,013 INFO [Listener at localhost/41149] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@725c4050{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/regionserver/,AVAILABLE}{file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/regionserver} 2023-07-15 16:21:50,014 INFO [Listener at localhost/41149] server.AbstractConnector(333): Started ServerConnector@4fbed378{HTTP/1.1, (http/1.1)}{0.0.0.0:32929} 2023-07-15 16:21:50,015 INFO [Listener at localhost/41149] server.Server(415): Started @6699ms 2023-07-15 16:21:50,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-15 16:21:50,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@46020f33{HTTP/1.1, (http/1.1)}{0.0.0.0:37341} 2023-07-15 16:21:50,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(415): Started @6708ms 2023-07-15 16:21:50,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:21:50,033 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 16:21:50,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:21:50,053 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:21:50,053 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:21:50,053 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:50,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 16:21:50,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36241,1689438108300 from backup master directory 2023-07-15 16:21:50,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 16:21:50,059 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:21:50,059 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 16:21:50,060 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:21:50,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:21:50,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 16:21:50,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 16:21:50,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/hbase.id with ID: 4b86a00f-b477-4006-828a-d34b75ef6208 2023-07-15 16:21:50,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:21:50,618 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:51,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x19da7ed6 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:21:51,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@770eb3c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:21:51,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:21:51,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 16:21:51,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 16:21:51,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 16:21:51,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:21:51,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:21:51,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:21:51,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store-tmp 2023-07-15 16:21:51,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:51,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 16:21:51,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:21:51,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:21:51,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 16:21:51,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:21:51,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:21:51,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:21:51,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/WALs/jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:21:51,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36241%2C1689438108300, suffix=, logDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/WALs/jenkins-hbase4.apache.org,36241,1689438108300, archiveDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/oldWALs, maxLogs=10 2023-07-15 16:21:51,297 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32857,DS-7001114a-0635-4c88-9f0c-83896a13df32,DISK] 2023-07-15 16:21:51,306 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:21:51,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/WALs/jenkins-hbase4.apache.org,36241,1689438108300/jenkins-hbase4.apache.org%2C36241%2C1689438108300.1689438111252 2023-07-15 16:21:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32857,DS-7001114a-0635-4c88-9f0c-83896a13df32,DISK]] 2023-07-15 16:21:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:21:51,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:51,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:21:51,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:21:51,434 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:21:51,441 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 16:21:51,472 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 16:21:51,484 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:51,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:21:51,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:21:51,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:21:51,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:21:51,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10845366560, jitterRate=0.010053470730781555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:21:51,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:21:51,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 16:21:51,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 16:21:51,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 16:21:51,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 16:21:51,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 16:21:51,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-15 16:21:51,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 16:21:51,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 16:21:51,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 16:21:51,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 16:21:51,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 16:21:51,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 16:21:51,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 16:21:51,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 16:21:51,669 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:51,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 16:21:51,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 16:21:51,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 16:21:51,689 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:21:51,689 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:21:51,689 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:51,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36241,1689438108300, sessionid=0x10169ca3a2d0000, setting cluster-up flag (Was=false) 2023-07-15 16:21:51,708 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:51,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 16:21:51,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:21:51,722 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:51,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 16:21:51,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:21:51,732 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp 2023-07-15 16:21:51,830 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(951): ClusterId : 4b86a00f-b477-4006-828a-d34b75ef6208 2023-07-15 16:21:51,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 16:21:51,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:21:51,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 16:21:51,841 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 16:21:51,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=VisibilityLabelsService 2023-07-15 16:21:51,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870913. 2023-07-15 16:21:51,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870914. 2023-07-15 16:21:51,851 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 16:21:51,852 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 16:21:51,856 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 16:21:51,857 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ReadOnlyZKClient(139): Connect 0x5446e307 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:21:51,866 DEBUG [RS:0;jenkins-hbase4:43575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a8117ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:21:51,867 DEBUG [RS:0;jenkins-hbase4:43575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ebe8877, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:21:51,903 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43575 2023-07-15 16:21:51,911 INFO [RS:0;jenkins-hbase4:43575] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 16:21:51,912 INFO [RS:0;jenkins-hbase4:43575] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 16:21:51,912 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 16:21:51,913 INFO [RS:0;jenkins-hbase4:43575] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:21:51,913 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 16:21:51,917 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36241,1689438108300 with isa=jenkins-hbase4.apache.org/172.31.14.131:43575, startcode=1689438109937 2023-07-15 16:21:51,943 DEBUG [RS:0;jenkins-hbase4:43575] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 16:21:51,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 16:21:51,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:21:51,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:21:51,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:21:51,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:21:51,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 16:21:51,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:51,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:21:51,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:51,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689438141962 2023-07-15 16:21:51,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 16:21:51,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 16:21:51,972 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 16:21:51,973 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 16:21:51,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 16:21:51,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 16:21:51,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 16:21:51,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 16:21:51,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:51,982 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:21:51,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 16:21:51,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 16:21:51,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 16:21:51,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 16:21:51,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 16:21:51,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689438111998,5,FailOnTimeoutGroup] 2023-07-15 16:21:51,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689438111998,5,FailOnTimeoutGroup] 2023-07-15 16:21:51,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:51,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 16:21:52,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,018 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41161, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 16:21:52,023 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 16:21:52,025 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 16:21:52,025 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72 2023-07-15 16:21:52,036 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36241] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:52,044 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:52,047 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 16:21:52,050 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/info 2023-07-15 16:21:52,051 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 16:21:52,053 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:52,053 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 16:21:52,057 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:21:52,058 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 16:21:52,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:52,060 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 16:21:52,062 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72 2023-07-15 16:21:52,062 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39495 2023-07-15 16:21:52,062 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=41385 2023-07-15 16:21:52,063 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/table 2023-07-15 16:21:52,064 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 16:21:52,065 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:52,067 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740 2023-07-15 16:21:52,068 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740 2023-07-15 16:21:52,069 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:21:52,070 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ZKUtil(162): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:52,070 WARN [RS:0;jenkins-hbase4:43575] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:21:52,071 INFO [RS:0;jenkins-hbase4:43575] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:21:52,072 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/WALs/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:52,074 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43575,1689438109937] 2023-07-15 16:21:52,076 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 16:21:52,079 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 16:21:52,083 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:21:52,085 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10573295840, jitterRate=-0.015285089612007141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 16:21:52,085 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ZKUtil(162): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:52,085 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 16:21:52,085 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 16:21:52,085 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 16:21:52,085 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 16:21:52,085 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 16:21:52,085 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 16:21:52,086 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 16:21:52,087 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 16:21:52,092 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 16:21:52,092 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 16:21:52,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 16:21:52,104 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 16:21:52,119 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 16:21:52,119 INFO [RS:0;jenkins-hbase4:43575] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 16:21:52,126 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 16:21:52,147 INFO [RS:0;jenkins-hbase4:43575] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 16:21:52,151 INFO [RS:0;jenkins-hbase4:43575] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 16:21:52,151 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,153 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 16:21:52,164 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,164 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,164 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,164 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,164 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,165 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,165 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:21:52,165 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,165 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,165 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,165 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:21:52,166 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,166 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,166 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,166 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,183 INFO [RS:0;jenkins-hbase4:43575] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 16:21:52,186 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43575,1689438109937-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,204 INFO [RS:0;jenkins-hbase4:43575] regionserver.Replication(203): jenkins-hbase4.apache.org,43575,1689438109937 started 2023-07-15 16:21:52,204 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43575,1689438109937, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43575, sessionid=0x10169ca3a2d0001 2023-07-15 16:21:52,204 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 16:21:52,204 DEBUG [RS:0;jenkins-hbase4:43575] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:52,204 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43575,1689438109937' 2023-07-15 16:21:52,204 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:21:52,205 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:21:52,206 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 16:21:52,206 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 16:21:52,206 DEBUG [RS:0;jenkins-hbase4:43575] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:52,206 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43575,1689438109937' 2023-07-15 16:21:52,206 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:21:52,207 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:21:52,207 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 16:21:52,207 INFO [RS:0;jenkins-hbase4:43575] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-15 16:21:52,209 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,210 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ZKUtil(398): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-15 16:21:52,210 INFO [RS:0;jenkins-hbase4:43575] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-15 16:21:52,210 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,211 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,278 DEBUG [jenkins-hbase4:36241] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-15 16:21:52,281 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43575,1689438109937, state=OPENING 2023-07-15 16:21:52,289 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 16:21:52,291 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:52,291 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 16:21:52,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43575,1689438109937}] 2023-07-15 16:21:52,323 INFO [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43575%2C1689438109937, suffix=, logDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/WALs/jenkins-hbase4.apache.org,43575,1689438109937, archiveDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/oldWALs, maxLogs=32 2023-07-15 16:21:52,348 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32857,DS-7001114a-0635-4c88-9f0c-83896a13df32,DISK] 2023-07-15 16:21:52,353 INFO [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/WALs/jenkins-hbase4.apache.org,43575,1689438109937/jenkins-hbase4.apache.org%2C43575%2C1689438109937.1689438112325 2023-07-15 16:21:52,354 DEBUG [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32857,DS-7001114a-0635-4c88-9f0c-83896a13df32,DISK]] 2023-07-15 16:21:52,490 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:52,493 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:21:52,498 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:21:52,510 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 16:21:52,510 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:21:52,514 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43575%2C1689438109937.meta, suffix=.meta, logDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/WALs/jenkins-hbase4.apache.org,43575,1689438109937, archiveDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/oldWALs, maxLogs=32 2023-07-15 16:21:52,533 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32857,DS-7001114a-0635-4c88-9f0c-83896a13df32,DISK] 2023-07-15 16:21:52,539 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/WALs/jenkins-hbase4.apache.org,43575,1689438109937/jenkins-hbase4.apache.org%2C43575%2C1689438109937.meta.1689438112516.meta 2023-07-15 16:21:52,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32857,DS-7001114a-0635-4c88-9f0c-83896a13df32,DISK]] 2023-07-15 16:21:52,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:21:52,541 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 16:21:52,543 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:21:52,543 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=VisibilityLabelsService 2023-07-15 16:21:52,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 16:21:52,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 16:21:52,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 16:21:52,554 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 16:21:52,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 16:21:52,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:52,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 16:21:52,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 16:21:52,575 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 16:21:52,577 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/info 2023-07-15 16:21:52,577 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/info 2023-07-15 16:21:52,578 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 16:21:52,578 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:52,579 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 16:21:52,580 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:21:52,580 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:21:52,581 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 16:21:52,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:52,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 16:21:52,583 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/table 2023-07-15 16:21:52,583 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/table 2023-07-15 16:21:52,584 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 16:21:52,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:52,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740 2023-07-15 16:21:52,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740 2023-07-15 16:21:52,595 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 16:21:52,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 16:21:52,599 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10963302560, jitterRate=0.021037116646766663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 16:21:52,607 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:52,616 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 16:21:52,626 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689438112479 2023-07-15 16:21:52,651 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 16:21:52,651 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 16:21:52,652 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43575,1689438109937, state=OPEN 2023-07-15 16:21:52,658 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 16:21:52,658 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 16:21:52,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 16:21:52,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43575,1689438109937 in 363 msec 2023-07-15 16:21:52,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 16:21:52,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 563 msec 2023-07-15 16:21:52,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 811 msec 2023-07-15 16:21:52,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689438112674, completionTime=-1 2023-07-15 16:21:52,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-15 16:21:52,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 16:21:52,743 DEBUG [hconnection-0x1356bbd4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:21:52,747 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:21:52,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-15 16:21:52,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689438172770 2023-07-15 16:21:52,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689438232770 2023-07-15 16:21:52,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 95 msec 2023-07-15 16:21:52,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36241,1689438108300-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36241,1689438108300-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36241,1689438108300-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36241, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:52,843 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 16:21:52,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 16:21:52,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:21:52,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 16:21:52,864 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:21:52,867 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:21:52,889 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:52,892 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7 empty. 2023-07-15 16:21:52,893 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:52,893 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 16:21:52,916 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 16:21:52,918 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3948cd00eb9c40844172648056a9bc7, NAME => 'hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp 2023-07-15 16:21:53,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:53,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c3948cd00eb9c40844172648056a9bc7, disabling compactions & flushes 2023-07-15 16:21:53,332 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:21:53,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:21:53,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. after waiting 0 ms 2023-07-15 16:21:53,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:21:53,332 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:21:53,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c3948cd00eb9c40844172648056a9bc7: 2023-07-15 16:21:53,338 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:21:53,362 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689438113342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689438113342"}]},"ts":"1689438113342"} 2023-07-15 16:21:53,390 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:21:53,392 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:21:53,396 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438113392"}]},"ts":"1689438113392"} 2023-07-15 16:21:53,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 16:21:53,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c3948cd00eb9c40844172648056a9bc7, ASSIGN}] 2023-07-15 16:21:53,409 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c3948cd00eb9c40844172648056a9bc7, ASSIGN 2023-07-15 16:21:53,411 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c3948cd00eb9c40844172648056a9bc7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689438109937; forceNewPlan=false, retain=false 2023-07-15 16:21:53,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c3948cd00eb9c40844172648056a9bc7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:53,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689438113562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689438113562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689438113562"}]},"ts":"1689438113562"} 2023-07-15 16:21:53,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c3948cd00eb9c40844172648056a9bc7, server=jenkins-hbase4.apache.org,43575,1689438109937}] 2023-07-15 16:21:53,730 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:21:53,731 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3948cd00eb9c40844172648056a9bc7, NAME => 'hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:21:53,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. service=AccessControlService 2023-07-15 16:21:53,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:21:53,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. service=VisibilityLabelsService 2023-07-15 16:21:53,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 16:21:53,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:53,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:53,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:53,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:53,735 INFO [StoreOpener-c3948cd00eb9c40844172648056a9bc7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:53,738 DEBUG [StoreOpener-c3948cd00eb9c40844172648056a9bc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7/info 2023-07-15 16:21:53,738 DEBUG [StoreOpener-c3948cd00eb9c40844172648056a9bc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7/info 2023-07-15 16:21:53,738 INFO [StoreOpener-c3948cd00eb9c40844172648056a9bc7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3948cd00eb9c40844172648056a9bc7 columnFamilyName info 2023-07-15 16:21:53,739 INFO [StoreOpener-c3948cd00eb9c40844172648056a9bc7-1] regionserver.HStore(310): Store=c3948cd00eb9c40844172648056a9bc7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:53,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:53,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:53,746 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:21:53,749 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:21:53,750 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3948cd00eb9c40844172648056a9bc7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11657554720, jitterRate=0.08569438755512238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:21:53,751 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3948cd00eb9c40844172648056a9bc7: 2023-07-15 16:21:53,753 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7., pid=6, masterSystemTime=1689438113723 2023-07-15 16:21:53,757 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:21:53,757 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:21:53,759 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c3948cd00eb9c40844172648056a9bc7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:53,759 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689438113758"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689438113758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689438113758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689438113758"}]},"ts":"1689438113758"} 2023-07-15 16:21:53,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 16:21:53,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c3948cd00eb9c40844172648056a9bc7, server=jenkins-hbase4.apache.org,43575,1689438109937 in 194 msec 2023-07-15 16:21:53,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 16:21:53,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c3948cd00eb9c40844172648056a9bc7, ASSIGN in 361 msec 2023-07-15 16:21:53,772 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:21:53,773 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438113773"}]},"ts":"1689438113773"} 2023-07-15 16:21:53,776 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 16:21:53,779 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:21:53,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 926 msec 2023-07-15 16:21:53,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 16:21:53,867 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:21:53,867 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:53,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 16:21:53,933 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:21:53,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-07-15 16:21:53,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 16:21:53,956 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:21:53,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-15 16:21:53,971 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 16:21:53,973 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 16:21:53,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.913sec 2023-07-15 16:21:53,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2023-07-15 16:21:53,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:21:53,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2023-07-15 16:21:53,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2023-07-15 16:21:53,979 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:21:53,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2023-07-15 16:21:53,980 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:21:53,985 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/quota/c382aa94961d91411475539686a9b61a 2023-07-15 16:21:53,986 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/quota/c382aa94961d91411475539686a9b61a empty. 2023-07-15 16:21:53,988 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/quota/c382aa94961d91411475539686a9b61a 2023-07-15 16:21:53,988 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2023-07-15 16:21:53,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2023-07-15 16:21:53,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2023-07-15 16:21:53,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:53,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:21:53,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 16:21:53,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 16:21:53,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36241,1689438108300-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 16:21:54,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36241,1689438108300-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 16:21:54,016 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2023-07-15 16:21:54,018 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => c382aa94961d91411475539686a9b61a, NAME => 'hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp 2023-07-15 16:21:54,037 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x6eafd7a0 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:21:54,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:21:54,039 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:54,040 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing c382aa94961d91411475539686a9b61a, disabling compactions & flushes 2023-07-15 16:21:54,040 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:21:54,040 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:21:54,040 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. after waiting 0 ms 2023-07-15 16:21:54,040 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:21:54,040 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:21:54,040 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for c382aa94961d91411475539686a9b61a: 2023-07-15 16:21:54,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 16:21:54,050 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:21:54,053 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:21:54,054 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:21:54,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 10 2023-07-15 16:21:54,057 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689438114057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689438114057"}]},"ts":"1689438114057"} 2023-07-15 16:21:54,057 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,057 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d92398f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:21:54,061 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:21:54,063 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:21:54,063 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438114063"}]},"ts":"1689438114063"} 2023-07-15 16:21:54,064 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240 empty. 2023-07-15 16:21:54,065 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,065 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 16:21:54,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-15 16:21:54,067 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2023-07-15 16:21:54,077 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=c382aa94961d91411475539686a9b61a, ASSIGN}] 2023-07-15 16:21:54,087 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=c382aa94961d91411475539686a9b61a, ASSIGN 2023-07-15 16:21:54,088 DEBUG [hconnection-0x73cf1cba-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:21:54,089 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=c382aa94961d91411475539686a9b61a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689438109937; forceNewPlan=false, retain=false 2023-07-15 16:21:54,108 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:21:54,111 INFO [Listener at localhost/41149] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:21:54,111 DEBUG [Listener at localhost/41149] client.AbstractTestShell(63): Configure jruby runtime, cluster set to org.apache.hadoop.hbase.HBaseTestingUtility@6f3fae6b 2023-07-15 16:21:54,241 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c382aa94961d91411475539686a9b61a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:54,241 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689438114241"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689438114241"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689438114241"}]},"ts":"1689438114241"} 2023-07-15 16:21:54,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure c382aa94961d91411475539686a9b61a, server=jenkins-hbase4.apache.org,43575,1689438109937}] 2023-07-15 16:21:54,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-15 16:21:54,404 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:21:54,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c382aa94961d91411475539686a9b61a, NAME => 'hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:21:54,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. service=AccessControlService 2023-07-15 16:21:54,404 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:21:54,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. service=VisibilityLabelsService 2023-07-15 16:21:54,405 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 16:21:54,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota c382aa94961d91411475539686a9b61a 2023-07-15 16:21:54,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:54,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c382aa94961d91411475539686a9b61a 2023-07-15 16:21:54,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c382aa94961d91411475539686a9b61a 2023-07-15 16:21:54,407 INFO [StoreOpener-c382aa94961d91411475539686a9b61a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region c382aa94961d91411475539686a9b61a 2023-07-15 16:21:54,409 DEBUG [StoreOpener-c382aa94961d91411475539686a9b61a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/q 2023-07-15 16:21:54,410 DEBUG [StoreOpener-c382aa94961d91411475539686a9b61a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/q 2023-07-15 16:21:54,410 INFO [StoreOpener-c382aa94961d91411475539686a9b61a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c382aa94961d91411475539686a9b61a columnFamilyName q 2023-07-15 16:21:54,411 INFO [StoreOpener-c382aa94961d91411475539686a9b61a-1] regionserver.HStore(310): Store=c382aa94961d91411475539686a9b61a/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:54,411 INFO [StoreOpener-c382aa94961d91411475539686a9b61a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region c382aa94961d91411475539686a9b61a 2023-07-15 16:21:54,414 DEBUG [StoreOpener-c382aa94961d91411475539686a9b61a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/u 2023-07-15 16:21:54,414 DEBUG [StoreOpener-c382aa94961d91411475539686a9b61a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/u 2023-07-15 16:21:54,414 INFO [StoreOpener-c382aa94961d91411475539686a9b61a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c382aa94961d91411475539686a9b61a columnFamilyName u 2023-07-15 16:21:54,415 INFO [StoreOpener-c382aa94961d91411475539686a9b61a-1] regionserver.HStore(310): Store=c382aa94961d91411475539686a9b61a/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:54,417 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a 2023-07-15 16:21:54,418 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a 2023-07-15 16:21:54,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 16:21:54,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c382aa94961d91411475539686a9b61a 2023-07-15 16:21:54,428 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:21:54,429 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c382aa94961d91411475539686a9b61a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11321336800, jitterRate=0.05438165366649628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 16:21:54,429 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c382aa94961d91411475539686a9b61a: 2023-07-15 16:21:54,431 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a., pid=12, masterSystemTime=1689438114398 2023-07-15 16:21:54,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:21:54,434 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:21:54,435 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c382aa94961d91411475539686a9b61a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:54,435 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689438114435"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689438114435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689438114435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689438114435"}]},"ts":"1689438114435"} 2023-07-15 16:21:54,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-07-15 16:21:54,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure c382aa94961d91411475539686a9b61a, server=jenkins-hbase4.apache.org,43575,1689438109937 in 193 msec 2023-07-15 16:21:54,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=9 2023-07-15 16:21:54,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=c382aa94961d91411475539686a9b61a, ASSIGN in 364 msec 2023-07-15 16:21:54,447 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:21:54,447 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438114447"}]},"ts":"1689438114447"} 2023-07-15 16:21:54,450 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2023-07-15 16:21:54,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:21:54,454 WARN [PEWorker-5] access.AccessController(784): Not adding owner permission for table hbase:quota. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-15 16:21:54,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 479 msec 2023-07-15 16:21:54,503 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 16:21:54,505 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 199cc9c28224c4acf0cc2d2c5cb5e240, NAME => 'hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp 2023-07-15 16:21:54,519 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:54,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 199cc9c28224c4acf0cc2d2c5cb5e240, disabling compactions & flushes 2023-07-15 16:21:54,520 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:21:54,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:21:54,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. after waiting 0 ms 2023-07-15 16:21:54,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:21:54,520 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:21:54,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 199cc9c28224c4acf0cc2d2c5cb5e240: 2023-07-15 16:21:54,524 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:21:54,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689438114525"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689438114525"}]},"ts":"1689438114525"} 2023-07-15 16:21:54,529 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:21:54,530 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:21:54,531 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438114530"}]},"ts":"1689438114530"} 2023-07-15 16:21:54,533 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 16:21:54,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=199cc9c28224c4acf0cc2d2c5cb5e240, ASSIGN}] 2023-07-15 16:21:54,539 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=199cc9c28224c4acf0cc2d2c5cb5e240, ASSIGN 2023-07-15 16:21:54,541 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=199cc9c28224c4acf0cc2d2c5cb5e240, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689438109937; forceNewPlan=false, retain=false 2023-07-15 16:21:54,693 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=199cc9c28224c4acf0cc2d2c5cb5e240, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:54,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689438114693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689438114693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689438114693"}]},"ts":"1689438114693"} 2023-07-15 16:21:54,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 199cc9c28224c4acf0cc2d2c5cb5e240, server=jenkins-hbase4.apache.org,43575,1689438109937}] 2023-07-15 16:21:54,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-15 16:21:54,857 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:21:54,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 199cc9c28224c4acf0cc2d2c5cb5e240, NAME => 'hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:21:54,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. service=AccessControlService 2023-07-15 16:21:54,858 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:21:54,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. service=VisibilityLabelsService 2023-07-15 16:21:54,858 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 16:21:54,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:54,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,861 INFO [StoreOpener-199cc9c28224c4acf0cc2d2c5cb5e240-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,863 DEBUG [StoreOpener-199cc9c28224c4acf0cc2d2c5cb5e240-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240/l 2023-07-15 16:21:54,863 DEBUG [StoreOpener-199cc9c28224c4acf0cc2d2c5cb5e240-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240/l 2023-07-15 16:21:54,863 INFO [StoreOpener-199cc9c28224c4acf0cc2d2c5cb5e240-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 199cc9c28224c4acf0cc2d2c5cb5e240 columnFamilyName l 2023-07-15 16:21:54,864 INFO [StoreOpener-199cc9c28224c4acf0cc2d2c5cb5e240-1] regionserver.HStore(310): Store=199cc9c28224c4acf0cc2d2c5cb5e240/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:54,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:21:54,880 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:21:54,881 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 199cc9c28224c4acf0cc2d2c5cb5e240; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9540496800, jitterRate=-0.1114719957113266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:21:54,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 199cc9c28224c4acf0cc2d2c5cb5e240: 2023-07-15 16:21:54,883 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240., pid=14, masterSystemTime=1689438114851 2023-07-15 16:21:54,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:21:54,887 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:21:54,887 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=199cc9c28224c4acf0cc2d2c5cb5e240, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:54,888 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689438114887"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689438114887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689438114887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689438114887"}]},"ts":"1689438114887"} 2023-07-15 16:21:54,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-15 16:21:54,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 199cc9c28224c4acf0cc2d2c5cb5e240, server=jenkins-hbase4.apache.org,43575,1689438109937 in 194 msec 2023-07-15 16:21:54,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-07-15 16:21:54,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=199cc9c28224c4acf0cc2d2c5cb5e240, ASSIGN in 372 msec 2023-07-15 16:21:54,914 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:21:54,915 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438114914"}]},"ts":"1689438114914"} 2023-07-15 16:21:54,917 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 16:21:54,922 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:21:55,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=hbase:acl in 883 msec 2023-07-15 16:21:55,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-15 16:21:55,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 10 completed 2023-07-15 16:21:55,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:21:55,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:labels 2023-07-15 16:21:55,583 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:21:55,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "labels" procId is: 15 2023-07-15 16:21:55,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-15 16:21:55,585 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:21:55,588 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:55,589 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946 empty. 2023-07-15 16:21:55,590 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:55,590 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:labels regions 2023-07-15 16:21:55,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-15 16:21:56,015 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/hbase/labels/.tabledesc/.tableinfo.0000000001 2023-07-15 16:21:56,017 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(7675): creating {ENCODED => d0c1c7ce1fb5a1e4d052733283e73946, NAME => 'hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp 2023-07-15 16:21:56,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-15 16:21:56,453 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(866): Instantiated hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:56,454 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1604): Closing d0c1c7ce1fb5a1e4d052733283e73946, disabling compactions & flushes 2023-07-15 16:21:56,454 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1626): Closing region hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:21:56,454 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:21:56,454 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. after waiting 0 ms 2023-07-15 16:21:56,454 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:21:56,454 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1838): Closed hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:21:56,454 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1558): Region close journal for d0c1c7ce1fb5a1e4d052733283e73946: 2023-07-15 16:21:56,458 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:21:56,459 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689438116459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689438116459"}]},"ts":"1689438116459"} 2023-07-15 16:21:56,462 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:21:56,463 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:21:56,463 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438116463"}]},"ts":"1689438116463"} 2023-07-15 16:21:56,465 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLING in hbase:meta 2023-07-15 16:21:56,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=d0c1c7ce1fb5a1e4d052733283e73946, ASSIGN}] 2023-07-15 16:21:56,472 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=d0c1c7ce1fb5a1e4d052733283e73946, ASSIGN 2023-07-15 16:21:56,473 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:labels, region=d0c1c7ce1fb5a1e4d052733283e73946, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689438109937; forceNewPlan=false, retain=false 2023-07-15 16:21:56,624 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d0c1c7ce1fb5a1e4d052733283e73946, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:56,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689438116624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689438116624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689438116624"}]},"ts":"1689438116624"} 2023-07-15 16:21:56,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure d0c1c7ce1fb5a1e4d052733283e73946, server=jenkins-hbase4.apache.org,43575,1689438109937}] 2023-07-15 16:21:56,785 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:21:56,785 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0c1c7ce1fb5a1e4d052733283e73946, NAME => 'hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:21:56,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. service=AccessControlService 2023-07-15 16:21:56,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:21:56,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. service=VisibilityLabelsService 2023-07-15 16:21:56,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 16:21:56,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table labels d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:56,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:21:56,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:56,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:56,789 INFO [StoreOpener-d0c1c7ce1fb5a1e4d052733283e73946-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:56,791 DEBUG [StoreOpener-d0c1c7ce1fb5a1e4d052733283e73946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946/f 2023-07-15 16:21:56,791 DEBUG [StoreOpener-d0c1c7ce1fb5a1e4d052733283e73946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946/f 2023-07-15 16:21:56,792 INFO [StoreOpener-d0c1c7ce1fb5a1e4d052733283e73946-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0c1c7ce1fb5a1e4d052733283e73946 columnFamilyName f 2023-07-15 16:21:56,793 INFO [StoreOpener-d0c1c7ce1fb5a1e4d052733283e73946-1] regionserver.HStore(310): Store=d0c1c7ce1fb5a1e4d052733283e73946/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:21:56,794 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:56,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:56,802 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:21:56,806 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:21:56,807 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0c1c7ce1fb5a1e4d052733283e73946; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@4abaaa49, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:21:56,820 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2023-07-15 16:21:56,820 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0c1c7ce1fb5a1e4d052733283e73946: 2023-07-15 16:21:56,822 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946., pid=17, masterSystemTime=1689438116780 2023-07-15 16:21:56,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:21:56,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(686): ZK sync() operation took 5ms 2023-07-15 16:21:56,825 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:21:56,826 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d0c1c7ce1fb5a1e4d052733283e73946, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:21:56,826 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689438116826"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689438116826"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689438116826"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689438116826"}]},"ts":"1689438116826"} 2023-07-15 16:21:56,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-15 16:21:56,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure d0c1c7ce1fb5a1e4d052733283e73946, server=jenkins-hbase4.apache.org,43575,1689438109937 in 203 msec 2023-07-15 16:21:56,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-15 16:21:56,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=hbase:labels, region=d0c1c7ce1fb5a1e4d052733283e73946, ASSIGN in 363 msec 2023-07-15 16:21:56,841 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:21:56,841 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438116841"}]},"ts":"1689438116841"} 2023-07-15 16:21:56,843 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLED in hbase:meta 2023-07-15 16:21:56,848 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:21:56,855 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey hbase:labels jenkins.hfs.0: RWXCA 2023-07-15 16:21:56,874 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[hbase:labels], kv [jenkins.hfs.0: RWXCA] 2023-07-15 16:21:56,918 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:21:56,918 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:21:56,918 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:21:56,922 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-15 16:21:56,925 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-15 16:21:56,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; CreateTableProcedure table=hbase:labels in 1.3440 sec 2023-07-15 16:21:57,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-15 16:21:57,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:labels, procId: 15 completed 2023-07-15 16:21:57,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 16:21:57,850 INFO [Listener at localhost/41149] hbase.ResourceChecker(147): before: client.TestQuotasShell#testRunShellTests Thread=236, OpenFileDescriptor=473, MaxFileDescriptor=60000, SystemLoadAverage=184, ProcessCount=173, AvailableMemoryMB=5282 2023-07-15 16:21:57,852 INFO [Listener at localhost/41149] client.AbstractTestShell(93): Starting ruby tests. includes: quotas_test.rb excludes: 2023-07-15 16:21:58,139 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 16:21:58,214 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 16:21:58,217 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 16:21:58,218 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:labels' 2023-07-15 16:21:58,220 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 16:21:58,221 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2023-07-15 16:21:58,462 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:21:58,463 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 16:21:58,463 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:21:58,463 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase RegionObservers 2023-07-15 16:21:58,464 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:21:58,464 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 16:21:58,464 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:21:58,464 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 16:21:58,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 16:21:58,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 16:21:58,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-15 16:21:58,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2023-07-15 16:21:58,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 16:21:58,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 16:21:58,466 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:21:58,466 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase MasterObservers Ruby description: jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 25.362-b09 on 1.8.0_362-b09 +jit [linux-x86_64] uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag Running tests... Skip commands_test.rb because of not included Skip formatter_test.rb because of not included Skip converter_test.rb because of not included Skip list_locks_test.rb because of not included Skip list_procedures_test.rb because of not included Skip rsgroup_shell_test.rb because of not included Skip noninteractive_test.rb because of not included Skip shell_test.rb because of not included Skip table_test.rb because of not included Skip admin2_test.rb because of not included Skip hbase_test.rb because of not included Skip taskmonitor_test.rb because of not included Skip admin_test.rb because of not included Skip replication_admin_test.rb because of not included loading test file 'quotas_test.rb'. Skip security_admin_test.rb because of not included Skip visibility_labels_admin_test.rb because of not included Loaded suite src/test/ruby/tests_runner Started 2023-07-15 16:22:01,192 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x06693b2c to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:01,200 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24db9ae9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:01,227 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:01,234 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:01,251 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:22:01,256 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 16:22:01,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:22:01,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase_shell_quota_tests_table 2023-07-15 16:22:01,269 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:22:01,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "hbase_shell_quota_tests_table" procId is: 18 2023-07-15 16:22:01,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-15 16:22:01,273 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:22:01,283 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:01,284 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff empty. 2023-07-15 16:22:01,286 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:01,286 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase_shell_quota_tests_table regions 2023-07-15 16:22:01,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-15 16:22:01,710 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp/data/default/hbase_shell_quota_tests_table/.tabledesc/.tableinfo.0000000001 2023-07-15 16:22:01,712 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6b98cef2e0556ae25ead2cee824aeff, NAME => 'hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.tmp 2023-07-15 16:22:02,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-15 16:22:02,124 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:22:02,125 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1604): Closing e6b98cef2e0556ae25ead2cee824aeff, disabling compactions & flushes 2023-07-15 16:22:02,125 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:02,125 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:02,125 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. after waiting 0 ms 2023-07-15 16:22:02,125 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:02,125 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:02,125 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1558): Region close journal for e6b98cef2e0556ae25ead2cee824aeff: 2023-07-15 16:22:02,130 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:22:02,131 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689438122131"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689438122131"}]},"ts":"1689438122131"} 2023-07-15 16:22:02,134 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:22:02,135 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:22:02,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438122135"}]},"ts":"1689438122135"} 2023-07-15 16:22:02,136 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLING in hbase:meta 2023-07-15 16:22:02,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=e6b98cef2e0556ae25ead2cee824aeff, ASSIGN}] 2023-07-15 16:22:02,143 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=e6b98cef2e0556ae25ead2cee824aeff, ASSIGN 2023-07-15 16:22:02,144 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=e6b98cef2e0556ae25ead2cee824aeff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689438109937; forceNewPlan=false, retain=false 2023-07-15 16:22:02,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e6b98cef2e0556ae25ead2cee824aeff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:02,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689438122295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689438122295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689438122295"}]},"ts":"1689438122295"} 2023-07-15 16:22:02,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure e6b98cef2e0556ae25ead2cee824aeff, server=jenkins-hbase4.apache.org,43575,1689438109937}] 2023-07-15 16:22:02,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:02,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6b98cef2e0556ae25ead2cee824aeff, NAME => 'hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:22:02,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. service=AccessControlService 2023-07-15 16:22:02,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:22:02,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. service=VisibilityLabelsService 2023-07-15 16:22:02,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 16:22:02,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table hbase_shell_quota_tests_table e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:02,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:22:02,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:02,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:02,462 INFO [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family x of region e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:02,464 DEBUG [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x 2023-07-15 16:22:02,464 DEBUG [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x 2023-07-15 16:22:02,465 INFO [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6b98cef2e0556ae25ead2cee824aeff columnFamilyName x 2023-07-15 16:22:02,465 INFO [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] regionserver.HStore(310): Store=e6b98cef2e0556ae25ead2cee824aeff/x, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:22:02,465 INFO [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family y of region e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:02,467 DEBUG [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/y 2023-07-15 16:22:02,467 DEBUG [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/y 2023-07-15 16:22:02,468 INFO [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6b98cef2e0556ae25ead2cee824aeff columnFamilyName y 2023-07-15 16:22:02,469 INFO [StoreOpener-e6b98cef2e0556ae25ead2cee824aeff-1] regionserver.HStore(310): Store=e6b98cef2e0556ae25ead2cee824aeff/y, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:22:02,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:02,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:02,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase_shell_quota_tests_table descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 16:22:02,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:22:02,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:22:02,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e6b98cef2e0556ae25ead2cee824aeff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10303008320, jitterRate=-0.040457576513290405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 16:22:02,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e6b98cef2e0556ae25ead2cee824aeff: 2023-07-15 16:22:02,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff., pid=20, masterSystemTime=1689438122451 2023-07-15 16:22:02,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:02,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:02,485 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e6b98cef2e0556ae25ead2cee824aeff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:02,486 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689438122485"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689438122485"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689438122485"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689438122485"}]},"ts":"1689438122485"} 2023-07-15 16:22:02,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-15 16:22:02,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure e6b98cef2e0556ae25ead2cee824aeff, server=jenkins-hbase4.apache.org,43575,1689438109937 in 190 msec 2023-07-15 16:22:02,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=18 2023-07-15 16:22:02,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=e6b98cef2e0556ae25ead2cee824aeff, ASSIGN in 350 msec 2023-07-15 16:22:02,496 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:22:02,496 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689438122496"}]},"ts":"1689438122496"} 2023-07-15 16:22:02,498 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLED in hbase:meta 2023-07-15 16:22:02,501 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:22:02,502 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey hbase_shell_quota_tests_table jenkins: RWXCA 2023-07-15 16:22:02,504 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-15 16:22:02,506 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:22:02,506 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:22:02,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-15 16:22:02,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-15 16:22:02,510 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-15 16:22:02,510 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-15 16:22:02,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; CreateTableProcedure table=hbase_shell_quota_tests_table in 1.2450 sec 2023-07-15 16:22:02,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-15 16:22:02,778 INFO [Listener at localhost/41149] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:hbase_shell_quota_tests_table, procId: 18 completed Created table hbase_shell_quota_tests_table Took 1.5425 seconds Took 0.0339 seconds 2023-07-15 16:22:02,874 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x4db68afb to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:02,880 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b6d4348, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:02,882 DEBUG [hconnection-0x79ecda5e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:02,885 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:02,897 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4db68afb to 127.0.0.1:52983 2023-07-15 16:22:02,897 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0055 seconds 2023-07-15 16:22:02,908 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x12979573 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:02,913 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@263bc912, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:02,916 DEBUG [hconnection-0x21838a88-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:02,918 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:02,923 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12979573 to 127.0.0.1:52983 2023-07-15 16:22:02,924 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0075 seconds 2023-07-15 16:22:02,933 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x280264cb to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:02,947 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9fe09e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:02,950 DEBUG [hconnection-0x13a67d56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:02,953 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:02,960 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x280264cb to 127.0.0.1:52983 2023-07-15 16:22:02,961 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:02,963 INFO [Listener at localhost/41149] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:22:02,963 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06693b2c to 127.0.0.1:52983 2023-07-15 16:22:02,964 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:22:02,967 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x6ab8a96b to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:02,988 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21cf2a1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:02,992 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:02,997 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,011 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:22:03,015 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0154 seconds 2023-07-15 16:22:03,021 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x46d83a72 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,033 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b219153, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,037 DEBUG [hconnection-0x396b5858-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,041 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,047 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46d83a72 to 127.0.0.1:52983 2023-07-15 16:22:03,048 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0079 seconds 2023-07-15 16:22:03,060 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x37ae0f19 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,069 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17f3cb2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,072 DEBUG [hconnection-0x56ecea5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,109 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,114 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37ae0f19 to 127.0.0.1:52983 2023-07-15 16:22:03,114 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:03,117 INFO [Listener at localhost/41149] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:22:03,117 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ab8a96b to 127.0.0.1:52983 2023-07-15 16:22:03,117 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:22:03,119 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x77012014 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,123 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bdec8ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,125 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,128 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,133 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:22:03,137 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0098 seconds 2023-07-15 16:22:03,143 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x22cb52e6 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,149 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c34c72b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,155 DEBUG [hconnection-0x21d24f0f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,157 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,164 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22cb52e6 to 127.0.0.1:52983 2023-07-15 16:22:03,164 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0057 seconds 2023-07-15 16:22:03,174 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x0f82ab44 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,179 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dea3b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,181 DEBUG [hconnection-0x4934aaf1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,186 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,192 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f82ab44 to 127.0.0.1:52983 2023-07-15 16:22:03,192 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0051 seconds 2023-07-15 16:22:03,200 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x199d0712 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,208 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62eecdf7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,210 DEBUG [hconnection-0x7f61a24e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,214 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,221 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x199d0712 to 127.0.0.1:52983 2023-07-15 16:22:03,222 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:03,223 INFO [Listener at localhost/41149] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:22:03,224 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77012014 to 127.0.0.1:52983 2023-07-15 16:22:03,224 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:22:03,226 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x7d61dd16 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,234 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54d9f28f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,236 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,239 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,246 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:22:03,248 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0086 seconds 2023-07-15 16:22:03,254 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x235f2c8e to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,260 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22a32fc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,263 DEBUG [hconnection-0x2a23b645-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,267 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,273 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x235f2c8e to 127.0.0.1:52983 2023-07-15 16:22:03,273 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0067 seconds 2023-07-15 16:22:03,284 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x4938ec91 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,289 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bfb5338, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,291 DEBUG [hconnection-0x209a055f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,294 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,299 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4938ec91 to 127.0.0.1:52983 2023-07-15 16:22:03,300 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:03,301 INFO [Listener at localhost/41149] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:22:03,302 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d61dd16 to 127.0.0.1:52983 2023-07-15 16:22:03,303 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:22:03,305 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x285a878e to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,312 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20a68f36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,411 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,413 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,420 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:22:03,422 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0106 seconds 2023-07-15 16:22:03,431 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x46483fce to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,437 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ad2a67e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,440 DEBUG [hconnection-0x2e99512d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,443 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,450 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46483fce to 127.0.0.1:52983 2023-07-15 16:22:03,451 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0054 seconds 2023-07-15 16:22:03,462 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x5d669871 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,470 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d466088, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,475 DEBUG [hconnection-0x182efa39-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,477 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,486 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d669871 to 127.0.0.1:52983 2023-07-15 16:22:03,486 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:03,488 INFO [Listener at localhost/41149] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:22:03,489 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x285a878e to 127.0.0.1:52983 2023-07-15 16:22:03,489 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:22:03,491 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x38ccf41d to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:03,501 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a97bd2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:03,506 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:03,507 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:03,513 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:22:03,517 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0105 seconds 2023-07-15 16:22:03,549 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:22:03,551 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService Took 0.0284 seconds Took 0.0022 seconds Took 0.0025 seconds Took 0.0030 seconds Took 0.0022 seconds Took 0.0023 seconds Took 0.0021 seconds Took 0.0042 seconds Took 0.0025 seconds Took 0.0020 seconds 2023-07-15 16:22:03,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 16:22:03,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-15 16:22:03,630 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-15 16:22:03,630 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 16:22:03,631 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-15 16:22:03,631 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-15 16:22:03,631 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,631 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:03,633 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 16:22:03,633 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 16:22:03,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:22:03,634 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,634 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:22:03,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:03,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 16:22:03,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:03,635 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-15 16:22:03,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-15 16:22:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-15 16:22:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 16:22:03,639 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-15 16:22:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 16:22:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 16:22:03,640 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:03,640 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. started... 2023-07-15 16:22:03,641 INFO [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e6b98cef2e0556ae25ead2cee824aeff 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-15 16:22:03,751 INFO [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=14 (bloomFilter=true), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/.tmp/x/3082ac3c84e346078dc7c233d20908d1 2023-07-15 16:22:03,812 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/.tmp/x/3082ac3c84e346078dc7c233d20908d1 as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/3082ac3c84e346078dc7c233d20908d1 2023-07-15 16:22:03,821 INFO [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/3082ac3c84e346078dc7c233d20908d1, entries=10, sequenceid=14, filesize=5.0 K 2023-07-15 16:22:03,825 INFO [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for e6b98cef2e0556ae25ead2cee824aeff in 184ms, sequenceid=14, compaction requested=false 2023-07-15 16:22:03,825 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase_shell_quota_tests_table' 2023-07-15 16:22:03,827 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e6b98cef2e0556ae25ead2cee824aeff: 2023-07-15 16:22:03,827 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:03,827 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 16:22:03,828 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 16:22:03,828 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,828 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-15 16:22:03,828 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689438109937' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-15 16:22:03,830 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:03,830 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:03,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 16:22:03,831 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:03,831 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:22:03,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:03,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:03,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689438109937' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-15 16:22:03,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@167aec95[Count = 0] remaining members to acquire global barrier 2023-07-15 16:22:03,833 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-15 16:22:03,833 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:03,835 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:03,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:03,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:03,835 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-15 16:22:03,835 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-15 16:22:03,835 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,43575,1689438109937' in zk 2023-07-15 16:22:03,835 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,835 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:22:03,839 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,839 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-15 16:22:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 16:22:03,839 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:22:03,839 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-15 16:22:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,43575,1689438109937': 2023-07-15 16:22:03,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689438109937' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-15 16:22:03,843 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-15 16:22:03,843 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:22:03,843 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:22:03,843 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-15 16:22:03,843 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 16:22:03,846 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,846 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 16:22:03,846 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 16:22:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:03,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 16:22:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:22:03,847 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:03,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,849 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:03,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,856 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,856 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 16:22:03,856 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 16:22:03,856 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:03,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 16:22:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:22:03,856 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:03,856 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:22:03,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-15 16:22:03,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 16:22:03,856 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:03,857 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:03,857 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:03,857 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:03,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 16:22:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:22:03,858 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-15 16:22:03,859 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 16:22:04,109 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 16:22:04,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.5354 seconds 2023-07-15 16:22:04,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 16:22:04,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689438124144 (current time:1689438124144). 2023-07-15 16:22:04,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:22:04,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ReadOnlyZKClient(139): Connect 0x749afbee to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:04,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d8f72c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:04,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:04,154 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:04,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x749afbee to 127.0.0.1:52983 2023-07-15 16:22:04,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:04,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ReadOnlyZKClient(139): Connect 0x77eca792 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:04,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@540a670a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:04,164 DEBUG [hconnection-0x72351639-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:04,166 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:04,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77eca792 to 127.0.0.1:52983 2023-07-15 16:22:04,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:04,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-15 16:22:04,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:22:04,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 16:22:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 16:22:04,214 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 16:22:04,215 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=21, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1689438724215 2023-07-15 16:22:04,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 16:22:04,215 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-15 16:22:04,217 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=21, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 16:22:04,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 16:22:04,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 11 msec 2023-07-15 16:22:04,220 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 16:22:04,221 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1689438724221 2023-07-15 16:22:04,221 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-15 16:22:04,222 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-15 16:22:04,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,239 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_1' 2023-07-15 16:22:04,239 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:22:04,240 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_1' starting 'acquire' 2023-07-15 16:22:04,240 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_1', kicking off acquire phase on members. 2023-07-15 16:22:04,241 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,241 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,242 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:22:04,242 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:22:04,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:22:04,243 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,243 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:22:04,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-15 16:22:04,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_1 from table hbase_shell_quota_tests_table type FLUSH 2023-07-15 16:22:04,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,247 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_1' with timeout 300000ms 2023-07-15 16:22:04,247 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:22:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_1' starting 'acquire' stage 2023-07-15 16:22:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_1' locally acquired 2023-07-15 16:22:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689438109937' joining acquired barrier for procedure (hbase_shell_quota_tests_table_1) in zk 2023-07-15 16:22:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,250 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:22:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,251 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:22:04,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:04,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:04,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:04,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689438109937' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_1' on coordinator 2023-07-15 16:22:04,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ffbc9e9[Count = 0] remaining members to acquire global barrier 2023-07-15 16:22:04,253 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_1' starting 'in-barrier' execution. 2023-07-15 16:22:04,253 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,256 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_1' received 'reached' from coordinator. 2023-07-15 16:22:04,256 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,256 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:22:04,257 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:22:04,257 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:22:04,257 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:04,257 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. started... 2023-07-15 16:22:04,258 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6b98cef2e0556ae25ead2cee824aeff: 2023-07-15 16:22:04,259 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.' region-info for snapshot=hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,267 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:22:04,273 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/3082ac3c84e346078dc7c233d20908d1] hfiles 2023-07-15 16:22:04,273 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/3082ac3c84e346078dc7c233d20908d1 for snapshot=hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,278 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:22:04,472 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:22:04,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 16:22:04,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:22:04,480 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 16:22:04,691 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. completed. 2023-07-15 16:22:04,691 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:04,691 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:22:04,692 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:22:04,692 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,692 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_1' locally completed 2023-07-15 16:22:04,692 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_1' completed for member 'jenkins-hbase4.apache.org,43575,1689438109937' in zk 2023-07-15 16:22:04,695 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_1' has notified controller of completion 2023-07-15 16:22:04,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:22:04,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:22:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_1' completed. 2023-07-15 16:22:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_1' member 'jenkins-hbase4.apache.org,43575,1689438109937': 2023-07-15 16:22:04,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689438109937' released barrier for procedure'hbase_shell_quota_tests_table_1', counting down latch. Waiting for 0 more 2023-07-15 16:22:04,700 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_1' execution completed 2023-07-15 16:22:04,700 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:22:04,700 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:22:04,700 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,700 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:22:04,704 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,704 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:22:04,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,704 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:22:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:04,705 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:22:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:22:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,706 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,714 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,715 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,715 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:22:04,715 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:22:04,715 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:22:04,715 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 because node does not exist (not an error) 2023-07-15 16:22:04,715 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:22:04,715 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:22:04,715 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,716 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,716 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:22:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:22:04,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-15 16:22:04,980 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:22:04,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 16:22:04,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:22:04,983 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-15 16:22:05,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 to hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/hbase_shell_quota_tests_table_1 2023-07-15 16:22:05,733 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:22:05,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 16:22:05,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:22:05,736 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2428): (#4) Sleeping: 1250ms while waiting for snapshot completion. 2023-07-15 16:22:05,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed 2023-07-15 16:22:05,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-15 16:22:05,998 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-15 16:22:05,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1689438124216Consolidate snapshot: hbase_shell_quota_tests_table_1 at 1689438124716 (+500 ms)Loading Region manifests for hbase_shell_quota_tests_table_1 at 1689438124716Writing data manifest for hbase_shell_quota_tests_table_1 at 1689438124730 (+14 ms)Verifying snapshot: hbase_shell_quota_tests_table_1 at 1689438125148 (+418 ms)Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed at 1689438125997 (+849 ms) 2023-07-15 16:22:05,999 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 16:22:06,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 1.7820 sec 2023-07-15 16:22:06,987 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:22:06,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 16:22:06,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 2.8664 seconds Took 0.0036 seconds Took 0.0037 seconds Took 0.0024 seconds Took 0.0025 seconds Took 0.0022 seconds Took 0.0028 seconds Took 0.0019 seconds Took 0.0024 seconds Took 0.0024 seconds Took 0.0023 seconds 2023-07-15 16:22:07,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 16:22:07,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] procedure.ProcedureCoordinator(143): Procedure hbase_shell_quota_tests_table was in running list but was completed. Accepting new attempt. 2023-07-15 16:22:07,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-15 16:22:07,054 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-15 16:22:07,054 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 16:22:07,055 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-15 16:22:07,055 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-15 16:22:07,055 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,056 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:07,057 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 16:22:07,057 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 16:22:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:22:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:07,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,059 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,059 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:22:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 16:22:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:07,059 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-15 16:22:07,060 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc hbase_shell_quota_tests_table is still present, removing 2023-07-15 16:22:07,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-15 16:22:07,060 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-15 16:22:07,060 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 16:22:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-15 16:22:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 16:22:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 16:22:07,061 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:07,061 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. started... 2023-07-15 16:22:07,062 INFO [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e6b98cef2e0556ae25ead2cee824aeff 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-15 16:22:07,089 INFO [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=28 (bloomFilter=true), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/.tmp/x/480c5f47ebd94e0aa13a9c97b15cbac0 2023-07-15 16:22:07,104 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/.tmp/x/480c5f47ebd94e0aa13a9c97b15cbac0 as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/480c5f47ebd94e0aa13a9c97b15cbac0 2023-07-15 16:22:07,115 INFO [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/480c5f47ebd94e0aa13a9c97b15cbac0, entries=10, sequenceid=28, filesize=5.0 K 2023-07-15 16:22:07,117 INFO [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for e6b98cef2e0556ae25ead2cee824aeff in 56ms, sequenceid=28, compaction requested=false 2023-07-15 16:22:07,117 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e6b98cef2e0556ae25ead2cee824aeff: 2023-07-15 16:22:07,117 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:07,117 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 16:22:07,118 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 16:22:07,118 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,118 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-15 16:22:07,118 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689438109937' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-15 16:22:07,120 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,120 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:07,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:07,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 16:22:07,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:07,121 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:07,121 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:22:07,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:07,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689438109937' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-15 16:22:07,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59804076[Count = 0] remaining members to acquire global barrier 2023-07-15 16:22:07,123 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-15 16:22:07,123 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:07,126 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:07,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:07,126 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-15 16:22:07,126 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-15 16:22:07,127 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,43575,1689438109937' in zk 2023-07-15 16:22:07,127 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,127 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:22:07,128 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-15 16:22:07,128 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,128 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:22:07,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:07,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 16:22:07,129 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-15 16:22:07,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:07,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:07,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:07,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,43575,1689438109937': 2023-07-15 16:22:07,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689438109937' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-15 16:22:07,133 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-15 16:22:07,133 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:22:07,133 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:22:07,133 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-15 16:22:07,134 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 16:22:07,136 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,136 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 16:22:07,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 16:22:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:22:07,137 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,137 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 16:22:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:07,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:07,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:07,139 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:07,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:07,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 16:22:07,143 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 16:22:07,143 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,143 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 16:22:07,143 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:22:07,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 16:22:07,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:22:07,143 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:07,144 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 16:22:07,144 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,144 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:07,144 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 16:22:07,144 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 16:22:07,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-15 16:22:07,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 16:22:07,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 16:22:07,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:22:07,144 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-15 16:22:07,145 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 16:22:07,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table because node does not exist (not an error) 2023-07-15 16:22:07,395 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 16:22:07,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.3666 seconds 2023-07-15 16:22:07,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 16:22:07,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689438127400 (current time:1689438127400). 2023-07-15 16:22:07,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:22:07,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ReadOnlyZKClient(139): Connect 0x396e31b2 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:07,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d2cdf76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:07,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:07,415 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:07,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x396e31b2 to 127.0.0.1:52983 2023-07-15 16:22:07,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:07,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ReadOnlyZKClient(139): Connect 0x0717d0a7 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:22:07,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3c8256, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:22:07,424 DEBUG [hconnection-0x248033a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:22:07,425 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:22:07,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0717d0a7 to 127.0.0.1:52983 2023-07-15 16:22:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:22:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-15 16:22:07,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:22:07,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 16:22:07,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 16:22:07,436 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 16:22:07,437 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=23, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1689438727437 2023-07-15 16:22:07,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 16:22:07,437 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-15 16:22:07,438 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-15 16:22:07,439 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-15 16:22:07,440 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=23, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 16:22:07,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 16:22:07,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 7 msec 2023-07-15 16:22:07,443 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 16:22:07,444 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=24, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1689438727444 2023-07-15 16:22:07,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,466 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_2' 2023-07-15 16:22:07,467 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:22:07,467 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_2' starting 'acquire' 2023-07-15 16:22:07,467 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_2', kicking off acquire phase on members. 2023-07-15 16:22:07,468 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,468 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,470 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:22:07,470 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:22:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:22:07,471 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,471 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:22:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-15 16:22:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_2 from table hbase_shell_quota_tests_table type FLUSH 2023-07-15 16:22:07,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,474 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_2' with timeout 300000ms 2023-07-15 16:22:07,474 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:22:07,475 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_2' starting 'acquire' stage 2023-07-15 16:22:07,475 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_2' locally acquired 2023-07-15 16:22:07,475 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689438109937' joining acquired barrier for procedure (hbase_shell_quota_tests_table_2) in zk 2023-07-15 16:22:07,478 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,478 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:07,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:22:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:22:07,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:07,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:07,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:07,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689438109937' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_2' on coordinator 2023-07-15 16:22:07,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d934e1[Count = 0] remaining members to acquire global barrier 2023-07-15 16:22:07,481 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_2' starting 'in-barrier' execution. 2023-07-15 16:22:07,481 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,483 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,484 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_2' received 'reached' from coordinator. 2023-07-15 16:22:07,484 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,485 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:22:07,485 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:22:07,485 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:22:07,485 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:07,485 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. started... 2023-07-15 16:22:07,485 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6b98cef2e0556ae25ead2cee824aeff: 2023-07-15 16:22:07,486 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.' region-info for snapshot=hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,486 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:22:07,486 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/3082ac3c84e346078dc7c233d20908d1, hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/480c5f47ebd94e0aa13a9c97b15cbac0] hfiles 2023-07-15 16:22:07,486 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/3082ac3c84e346078dc7c233d20908d1 for snapshot=hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,486 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/x/480c5f47ebd94e0aa13a9c97b15cbac0 for snapshot=hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,486 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:22:07,499 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. completed. 2023-07-15 16:22:07,500 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689438109937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:22:07,500 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:22:07,500 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:22:07,500 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,500 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_2' locally completed 2023-07-15 16:22:07,500 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_2' completed for member 'jenkins-hbase4.apache.org,43575,1689438109937' in zk 2023-07-15 16:22:07,502 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_2' has notified controller of completion 2023-07-15 16:22:07,502 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,502 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:22:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:22:07,503 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_2' completed. 2023-07-15 16:22:07,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:07,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:07,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:07,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_2' member 'jenkins-hbase4.apache.org,43575,1689438109937': 2023-07-15 16:22:07,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689438109937' released barrier for procedure'hbase_shell_quota_tests_table_2', counting down latch. Waiting for 0 more 2023-07-15 16:22:07,507 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_2' execution completed 2023-07-15 16:22:07,507 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:22:07,507 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:22:07,507 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,507 INFO [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_2including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:22:07,510 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,510 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:22:07,510 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:22:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:22:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:22:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:22:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:22:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,516 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:22:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,518 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:22:07,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,522 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,522 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,522 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,522 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:22:07,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:22:07,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,522 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:22:07,522 DEBUG [(jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:22:07,523 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:22:07,523 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,522 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:22:07,524 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:22:07,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:22:07,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,690 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:22:07,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 16:22:07,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:22:07,692 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 16:22:07,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 to hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/hbase_shell_quota_tests_table_2 2023-07-15 16:22:07,964 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 16:22:08,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed 2023-07-15 16:22:08,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-15 16:22:08,060 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-15 16:22:08,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1689438127437Consolidate snapshot: hbase_shell_quota_tests_table_2 at 1689438127522 (+85 ms)Loading Region manifests for hbase_shell_quota_tests_table_2 at 1689438127523 (+1 ms)Writing data manifest for hbase_shell_quota_tests_table_2 at 1689438127532 (+9 ms)Verifying snapshot: hbase_shell_quota_tests_table_2 at 1689438127947 (+415 ms)Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed at 1689438128059 (+112 ms) 2023-07-15 16:22:08,061 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=24, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 16:22:08,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 623 msec 2023-07-15 16:22:08,192 DEBUG [Listener at localhost/41149] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:22:08,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 16:22:08,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 0.7973 seconds 2023-07-15 16:23:56,319 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae2deeba7a28b5de: from storage DS-7001114a-0635-4c88-9f0c-83896a13df32 node DatanodeRegistration(127.0.0.1:32857, datanodeUuid=27f5a0f1-7325-4d4d-a42d-01f4cb7e3898, infoPort=46753, infoSecurePort=0, ipcPort=41149, storageInfo=lv=-57;cid=testClusterID;nsid=2005123095;c=1689438105259), blocks: 13, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 16:23:56,320 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae2deeba7a28b5de: from storage DS-b3503e3a-d2c6-4492-a3d9-d047cba0effc node DatanodeRegistration(127.0.0.1:32857, datanodeUuid=27f5a0f1-7325-4d4d-a42d-01f4cb7e3898, infoPort=46753, infoSecurePort=0, ipcPort=41149, storageInfo=lv=-57;cid=testClusterID;nsid=2005123095;c=1689438105259), blocks: 12, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:24:09,561 DEBUG [master/jenkins-hbase4:0.Chore.1] quotas.QuotaObserverChore(336): hbase_shell_quota_tests_table moved into observance of table space quota. 2023-07-15 16:26:49,960 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache(965): totalSize=587.81 KB, freeSize=781.83 MB, max=782.40 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2023-07-15 16:26:50,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): data stats (chunk size=2097152): current pool size=1, created chunk count=9, reused chunk count=1, reuseRatio=10.00% 2023-07-15 16:26:50,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2023-07-15 16:26:52,204 INFO [jenkins-hbase4:43575Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-15 16:26:54,221 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. because c3948cd00eb9c40844172648056a9bc7/info has an old edit so flush to free WALs after random delay 201779 ms 2023-07-15 16:26:54,222 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because 1588230740/info has an old edit so flush to free WALs after random delay 72101 ms 2023-07-15 16:26:55,193 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 16:26:55,199 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(200): Skipping table hbase_shell_quota_tests_table because normalization is disabled in its table properties and normalization is also disabled at table level by default 2023-07-15 16:26:55,200 DEBUG [master/jenkins-hbase4:0.Chore.1] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster. 2023-07-15 16:26:55,200 DEBUG [master/jenkins-hbase4:0.Chore.1] master.HMaster(1882): Balancer is going into sleep until next period in 300000ms 2023-07-15 16:26:57,170 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. because d0c1c7ce1fb5a1e4d052733283e73946/f has an old edit so flush to free WALs after random delay 248789 ms 2023-07-15 16:26:57,170 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. because 199cc9c28224c4acf0cc2d2c5cb5e240/l has an old edit so flush to free WALs after random delay 159627 ms 2023-07-15 16:26:58,108 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 16:27:03,172 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. because c382aa94961d91411475539686a9b61a/q has an old edit so flush to free WALs after random delay 282520 ms 2023-07-15 16:27:03,551 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:27:03,552 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2023-07-15 16:27:53,998 DEBUG [master/jenkins-hbase4:0.Chore.1] zookeeper.ReadOnlyZKClient(139): Connect 0x05a6bebe to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:54,003 DEBUG [master/jenkins-hbase4:0.Chore.1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b3d43f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:54,005 DEBUG [hconnection-0x977dbc0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:54,006 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:27:58,533 INFO [Listener at localhost/41149] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:27:58,534 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38ccf41d to 127.0.0.1:52983 2023-07-15 16:27:58,534 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,538 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x201f034b to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,543 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ef348e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,545 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,547 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:27:58,554 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x201f034b to 127.0.0.1:52983 2023-07-15 16:27:58,554 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,559 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x7d722920 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,563 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@225eb4af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,565 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,567 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:27:58,574 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d722920 to 127.0.0.1:52983 2023-07-15 16:27:58,574 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,575 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x44f70495 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,579 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50331519, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,581 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,583 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:27:58,588 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44f70495 to 127.0.0.1:52983 2023-07-15 16:27:58,589 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,590 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x70a43b1f to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,599 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6098c271, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,601 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,603 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0108 seconds Took 0.0010 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0007 seconds Took 0.0007 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0008 seconds 2023-07-15 16:27:58,644 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70a43b1f to 127.0.0.1:52983 2023-07-15 16:27:58,644 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,646 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x1b2343e2 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,650 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@553ba5df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,652 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,654 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0008 seconds 2023-07-15 16:27:58,661 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b2343e2 to 127.0.0.1:52983 2023-07-15 16:27:58,661 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,663 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x6d5ed296 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,666 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7426c9eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,668 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,669 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0008 seconds 2023-07-15 16:27:58,675 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d5ed296 to 127.0.0.1:52983 2023-07-15 16:27:58,675 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,678 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x1ae85302 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,683 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a2e12ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,685 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,687 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0010 seconds 2023-07-15 16:27:58,692 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ae85302 to 127.0.0.1:52983 2023-07-15 16:27:58,693 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,694 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x7ca35d8a to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,699 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@243b0419, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,701 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,703 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:27:58,707 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:27:58,709 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0063 seconds 2023-07-15 16:27:58,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from false to true 2023-07-15 16:27:58,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from true to false Took 0.0028 seconds 2023-07-15 16:27:58,730 INFO [Listener at localhost/41149] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:27:58,731 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ca35d8a to 127.0.0.1:52983 2023-07-15 16:27:58,731 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:58,733 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x6a95d714 to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:58,738 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33ee2a78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:58,740 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:58,741 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:27:58,746 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:27:58,748 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 16:27:58,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] zookeeper.ZKUtil(398): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-15 16:27:58,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from true to false 2023-07-15 16:27:58,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] procedure2.ProcedureExecutor(1029): Stored pid=25, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,36241,1689438108300, rpcThrottleEnabled=false 2023-07-15 16:27:58,766 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:27:58,768 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,43575,1689438109937, rpcThrottleEnabled=false}] 2023-07-15 16:27:58,927 DEBUG [RSProcedureDispatcher-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:27:58,929 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:27:58,930 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43575] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=26 2023-07-15 16:27:58,931 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from true to false 2023-07-15 16:27:58,933 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=26 2023-07-15 16:27:58,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36241] master.HMaster(3641): Remote procedure done, pid=26 2023-07-15 16:27:58,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=25 2023-07-15 16:27:58,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=25, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,43575,1689438109937, rpcThrottleEnabled=false in 169 msec 2023-07-15 16:27:58,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,36241,1689438108300, rpcThrottleEnabled=false in 187 msec 2023-07-15 16:27:58,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from false to true 2023-07-15 16:27:58,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36241] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,36241,1689438108300, rpcThrottleEnabled=true 2023-07-15 16:27:58,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,43575,1689438109937, rpcThrottleEnabled=true}] 2023-07-15 16:27:59,100 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43575] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=28 2023-07-15 16:27:59,101 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from false to true 2023-07-15 16:27:59,101 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=28 2023-07-15 16:27:59,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36241] master.HMaster(3641): Remote procedure done, pid=28 2023-07-15 16:27:59,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 16:27:59,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,43575,1689438109937, rpcThrottleEnabled=true in 155 msec 2023-07-15 16:27:59,107 INFO [Listener at localhost/41149] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:27:59,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,36241,1689438108300, rpcThrottleEnabled=true in 162 msec 2023-07-15 16:27:59,108 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a95d714 to 127.0.0.1:52983 2023-07-15 16:27:59,108 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 16:27:59,111 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(139): Connect 0x45da0bdd to 127.0.0.1:52983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:27:59,115 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21191db0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 16:27:59,117 DEBUG [Listener at localhost/41149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:27:59,119 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0010 seconds 2023-07-15 16:27:59,124 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45da0bdd to 127.0.0.1:52983 2023-07-15 16:27:59,124 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client . Finished in 357.946611 seconds. ------------------------------------------------------------------------------- 16 tests, 62 assertions, 0 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications 100% passed ------------------------------------------------------------------------------- 0.04 tests/s, 0.17 assertions/s Done with tests! Shutting down the cluster... 2023-07-15 16:27:59,149 INFO [Listener at localhost/41149] hbase.ResourceChecker(175): after: client.TestQuotasShell#testRunShellTests Thread=260 (was 236) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x05a6bebe-SendThread(127.0.0.1:52983) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x6a95d714-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x6a95d714-SendThread(127.0.0.1:52983) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x45da0bdd java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/776872362.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x45da0bdd-SendThread(127.0.0.1:52983) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x45da0bdd-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x6a95d714 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/776872362.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x6d5ed296-SendThread(127.0.0.1:52983) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x1ae85302-SendThread(127.0.0.1:52983) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x05a6bebe sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/776872362.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43575,1689438109937' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36241,1689438108300)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Ruby-0-JIT-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x6d5ed296 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/776872362.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x1b2343e2 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/776872362.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x1ae85302 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/776872362.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x1b2343e2-SendThread(127.0.0.1:52983) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x05a6bebe-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x1b2343e2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x6d5ed296-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52983@0x1ae85302-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jnr.ffi.util.ref.internal.Finalizer java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) jnr.ffi.util.ref.internal.Finalizer.run(Finalizer.java:180) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=489 (was 473) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=2 (was 184), ProcessCount=170 (was 173), AvailableMemoryMB=5486 (was 5282) - AvailableMemoryMB LEAK? - 2023-07-15 16:27:59,151 INFO [Listener at localhost/41149] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 16:27:59,151 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6eafd7a0 to 127.0.0.1:52983 2023-07-15 16:27:59,151 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:27:59,151 DEBUG [Listener at localhost/41149] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 16:27:59,151 DEBUG [Listener at localhost/41149] util.JVMClusterUtil(257): Found active master hash=1615532201, stopped=false 2023-07-15 16:27:59,152 DEBUG [Listener at localhost/41149] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:27:59,152 DEBUG [Listener at localhost/41149] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 16:27:59,152 DEBUG [Listener at localhost/41149] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:27:59,152 DEBUG [Listener at localhost/41149] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-15 16:27:59,152 INFO [Listener at localhost/41149] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:27:59,153 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:27:59,154 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:27:59,154 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:27:59,154 INFO [Listener at localhost/41149] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 16:27:59,154 DEBUG [Listener at localhost/41149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19da7ed6 to 127.0.0.1:52983 2023-07-15 16:27:59,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:27:59,154 DEBUG [Listener at localhost/41149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:27:59,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:27:59,155 INFO [Listener at localhost/41149] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43575,1689438109937' ***** 2023-07-15 16:27:59,155 DEBUG [Listener at localhost/41149] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:27:59,155 INFO [Listener at localhost/41149] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 16:27:59,155 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-15 16:27:59,159 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:27:59,164 INFO [RS:0;jenkins-hbase4:43575] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@725c4050{regionserver,/,null,STOPPED}{file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/regionserver} 2023-07-15 16:27:59,168 INFO [RS:0;jenkins-hbase4:43575] server.AbstractConnector(383): Stopped ServerConnector@4fbed378{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-15 16:27:59,168 INFO [RS:0;jenkins-hbase4:43575] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-15 16:27:59,169 INFO [RS:0;jenkins-hbase4:43575] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2d65ddc4{static,/static,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/static/,STOPPED} 2023-07-15 16:27:59,169 INFO [RS:0;jenkins-hbase4:43575] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@4e3578a1{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/hadoop.log.dir/,STOPPED} 2023-07-15 16:27:59,171 INFO [RS:0;jenkins-hbase4:43575] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 16:27:59,172 INFO [RS:0;jenkins-hbase4:43575] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 16:27:59,172 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 16:27:59,172 INFO [RS:0;jenkins-hbase4:43575] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 16:27:59,172 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(3305): Received CLOSE for c3948cd00eb9c40844172648056a9bc7 2023-07-15 16:27:59,173 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(3305): Received CLOSE for d0c1c7ce1fb5a1e4d052733283e73946 2023-07-15 16:27:59,173 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(3305): Received CLOSE for c382aa94961d91411475539686a9b61a 2023-07-15 16:27:59,173 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(3305): Received CLOSE for 199cc9c28224c4acf0cc2d2c5cb5e240 2023-07-15 16:27:59,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3948cd00eb9c40844172648056a9bc7, disabling compactions & flushes 2023-07-15 16:27:59,173 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(3305): Received CLOSE for e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:27:59,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:27:59,173 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:27:59,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:27:59,173 INFO [RS:0;jenkins-hbase4:43575] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:27:59,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. after waiting 0 ms 2023-07-15 16:27:59,174 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5446e307 to 127.0.0.1:52983 2023-07-15 16:27:59,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:27:59,174 DEBUG [RS:0;jenkins-hbase4:43575] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:27:59,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c3948cd00eb9c40844172648056a9bc7 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 16:27:59,174 INFO [RS:0;jenkins-hbase4:43575] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 16:27:59,174 INFO [RS:0;jenkins-hbase4:43575] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 16:27:59,174 INFO [RS:0;jenkins-hbase4:43575] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 16:27:59,174 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 16:27:59,174 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1474): Waiting on 6 regions to close 2023-07-15 16:27:59,174 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1478): Online Regions={c3948cd00eb9c40844172648056a9bc7=hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7., d0c1c7ce1fb5a1e4d052733283e73946=hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946., c382aa94961d91411475539686a9b61a=hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a., 199cc9c28224c4acf0cc2d2c5cb5e240=hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240., 1588230740=hbase:meta,,1.1588230740, e6b98cef2e0556ae25ead2cee824aeff=hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.} 2023-07-15 16:27:59,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 16:27:59,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 16:27:59,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 16:27:59,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 16:27:59,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 16:27:59,175 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 1588230740, 199cc9c28224c4acf0cc2d2c5cb5e240, c382aa94961d91411475539686a9b61a, c3948cd00eb9c40844172648056a9bc7, d0c1c7ce1fb5a1e4d052733283e73946, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:27:59,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=6.34 KB heapSize=11.52 KB 2023-07-15 16:27:59,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7/.tmp/info/40000e944f9a47dfbbd36348ec17960b 2023-07-15 16:27:59,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7/.tmp/info/40000e944f9a47dfbbd36348ec17960b as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7/info/40000e944f9a47dfbbd36348ec17960b 2023-07-15 16:27:59,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7/info/40000e944f9a47dfbbd36348ec17960b, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 16:27:59,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c3948cd00eb9c40844172648056a9bc7 in 39ms, sequenceid=6, compaction requested=false 2023-07-15 16:27:59,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/namespace/c3948cd00eb9c40844172648056a9bc7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:27:59,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:27:59,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:27:59,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:27:59,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3948cd00eb9c40844172648056a9bc7: 2023-07-15 16:27:59,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689438112852.c3948cd00eb9c40844172648056a9bc7. 2023-07-15 16:27:59,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0c1c7ce1fb5a1e4d052733283e73946, disabling compactions & flushes 2023-07-15 16:27:59,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:27:59,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:27:59,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. after waiting 0 ms 2023-07-15 16:27:59,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:27:59,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d0c1c7ce1fb5a1e4d052733283e73946 1/1 column families, dataSize=32 B heapSize=360 B 2023-07-15 16:27:59,230 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 16:27:59,230 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 16:27:59,376 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 1588230740, 199cc9c28224c4acf0cc2d2c5cb5e240, c382aa94961d91411475539686a9b61a, d0c1c7ce1fb5a1e4d052733283e73946, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:27:59,576 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 1588230740, 199cc9c28224c4acf0cc2d2c5cb5e240, c382aa94961d91411475539686a9b61a, d0c1c7ce1fb5a1e4d052733283e73946, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:27:59,597 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.88 KB at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/.tmp/info/f3f8359f6123434e9d0bc17d364f7959 2023-07-15 16:27:59,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32 B at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946/.tmp/f/eea2f7690bd74953b44930f1d7a314f1 2023-07-15 16:27:59,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946/.tmp/f/eea2f7690bd74953b44930f1d7a314f1 as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946/f/eea2f7690bd74953b44930f1d7a314f1 2023-07-15 16:27:59,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946/f/eea2f7690bd74953b44930f1d7a314f1, entries=1, sequenceid=4, filesize=4.6 K 2023-07-15 16:27:59,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32 B/32, heapSize ~344 B/344, currentSize=0 B/0 for d0c1c7ce1fb5a1e4d052733283e73946 in 425ms, sequenceid=4, compaction requested=false 2023-07-15 16:27:59,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/labels/d0c1c7ce1fb5a1e4d052733283e73946/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=1 2023-07-15 16:27:59,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:27:59,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:27:59,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:27:59,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0c1c7ce1fb5a1e4d052733283e73946: 2023-07-15 16:27:59,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:labels,,1689438115578.d0c1c7ce1fb5a1e4d052733283e73946. 2023-07-15 16:27:59,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c382aa94961d91411475539686a9b61a, disabling compactions & flushes 2023-07-15 16:27:59,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:27:59,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:27:59,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. after waiting 0 ms 2023-07-15 16:27:59,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:27:59,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c382aa94961d91411475539686a9b61a 2/2 column families, dataSize=1.31 KB heapSize=3.84 KB 2023-07-15 16:27:59,776 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 1588230740, 199cc9c28224c4acf0cc2d2c5cb5e240, c382aa94961d91411475539686a9b61a, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:27:59,976 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 1588230740, 199cc9c28224c4acf0cc2d2c5cb5e240, c382aa94961d91411475539686a9b61a, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:28:00,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=472 B at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/.tmp/table/d5db34add7fb41ddb585e948ef424aee 2023-07-15 16:28:00,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/.tmp/info/f3f8359f6123434e9d0bc17d364f7959 as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/info/f3f8359f6123434e9d0bc17d364f7959 2023-07-15 16:28:00,029 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/info/f3f8359f6123434e9d0bc17d364f7959, entries=50, sequenceid=29, filesize=10.6 K 2023-07-15 16:28:00,030 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/.tmp/table/d5db34add7fb41ddb585e948ef424aee as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/table/d5db34add7fb41ddb585e948ef424aee 2023-07-15 16:28:00,037 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/table/d5db34add7fb41ddb585e948ef424aee, entries=10, sequenceid=29, filesize=5.1 K 2023-07-15 16:28:00,038 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~6.34 KB/6489, heapSize ~11.23 KB/11504, currentSize=0 B/0 for 1588230740 in 863ms, sequenceid=29, compaction requested=false 2023-07-15 16:28:00,044 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/meta/1588230740/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-15 16:28:00,045 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:28:00,045 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 16:28:00,045 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:28:00,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 16:28:00,046 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 16:28:00,046 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 16:28:00,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=830 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/.tmp/q/dd473244ba4b48ed851f02546f623295 2023-07-15 16:28:00,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd473244ba4b48ed851f02546f623295 2023-07-15 16:28:00,177 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-15 16:28:00,177 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1478): Online Regions={c382aa94961d91411475539686a9b61a=hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a., 199cc9c28224c4acf0cc2d2c5cb5e240=hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240., e6b98cef2e0556ae25ead2cee824aeff=hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff.} 2023-07-15 16:28:00,177 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 199cc9c28224c4acf0cc2d2c5cb5e240, c382aa94961d91411475539686a9b61a, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:28:00,377 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 199cc9c28224c4acf0cc2d2c5cb5e240, c382aa94961d91411475539686a9b61a, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:28:00,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=510 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/.tmp/u/1a4e4cd39ba14fa2ab63d603eb6b4f00 2023-07-15 16:28:00,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a4e4cd39ba14fa2ab63d603eb6b4f00 2023-07-15 16:28:00,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/.tmp/q/dd473244ba4b48ed851f02546f623295 as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/q/dd473244ba4b48ed851f02546f623295 2023-07-15 16:28:00,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd473244ba4b48ed851f02546f623295 2023-07-15 16:28:00,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/q/dd473244ba4b48ed851f02546f623295, entries=8, sequenceid=24, filesize=5.2 K 2023-07-15 16:28:00,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/.tmp/u/1a4e4cd39ba14fa2ab63d603eb6b4f00 as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/u/1a4e4cd39ba14fa2ab63d603eb6b4f00 2023-07-15 16:28:00,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a4e4cd39ba14fa2ab63d603eb6b4f00 2023-07-15 16:28:00,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/u/1a4e4cd39ba14fa2ab63d603eb6b4f00, entries=10, sequenceid=24, filesize=5.4 K 2023-07-15 16:28:00,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.31 KB/1340, heapSize ~3.80 KB/3896, currentSize=0 B/0 for c382aa94961d91411475539686a9b61a in 849ms, sequenceid=24, compaction requested=false 2023-07-15 16:28:00,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/quota/c382aa94961d91411475539686a9b61a/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-15 16:28:00,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:28:00,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:28:00,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:28:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c382aa94961d91411475539686a9b61a: 2023-07-15 16:28:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1689438113975.c382aa94961d91411475539686a9b61a. 2023-07-15 16:28:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 199cc9c28224c4acf0cc2d2c5cb5e240, disabling compactions & flushes 2023-07-15 16:28:00,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:28:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:28:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. after waiting 0 ms 2023-07-15 16:28:00,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:28:00,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 199cc9c28224c4acf0cc2d2c5cb5e240 1/1 column families, dataSize=113 B heapSize=520 B 2023-07-15 16:28:00,577 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 199cc9c28224c4acf0cc2d2c5cb5e240, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:28:00,777 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 199cc9c28224c4acf0cc2d2c5cb5e240, e6b98cef2e0556ae25ead2cee824aeff 2023-07-15 16:28:00,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=113 B at sequenceid=6 (bloomFilter=false), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240/.tmp/l/e71ae8f2f7cb40b3ae939285b2788dcb 2023-07-15 16:28:00,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240/.tmp/l/e71ae8f2f7cb40b3ae939285b2788dcb as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240/l/e71ae8f2f7cb40b3ae939285b2788dcb 2023-07-15 16:28:00,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240/l/e71ae8f2f7cb40b3ae939285b2788dcb, entries=2, sequenceid=6, filesize=4.7 K 2023-07-15 16:28:00,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~113 B/113, heapSize ~504 B/504, currentSize=0 B/0 for 199cc9c28224c4acf0cc2d2c5cb5e240 in 424ms, sequenceid=6, compaction requested=false 2023-07-15 16:28:00,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/hbase/acl/199cc9c28224c4acf0cc2d2c5cb5e240/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:28:00,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:28:00,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:28:00,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:28:00,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 199cc9c28224c4acf0cc2d2c5cb5e240: 2023-07-15 16:28:00,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689438114026.199cc9c28224c4acf0cc2d2c5cb5e240. 2023-07-15 16:28:00,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e6b98cef2e0556ae25ead2cee824aeff, disabling compactions & flushes 2023-07-15 16:28:00,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:28:00,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:28:00,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. after waiting 0 ms 2023-07-15 16:28:00,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:28:00,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/data/default/hbase_shell_quota_tests_table/e6b98cef2e0556ae25ead2cee824aeff/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-15 16:28:00,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:28:00,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 16:28:00,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:28:00,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e6b98cef2e0556ae25ead2cee824aeff: 2023-07-15 16:28:00,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase_shell_quota_tests_table,,1689438121264.e6b98cef2e0556ae25ead2cee824aeff. 2023-07-15 16:28:00,978 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43575,1689438109937; all regions closed. 2023-07-15 16:28:00,978 DEBUG [RS:0;jenkins-hbase4:43575] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-15 16:28:00,989 DEBUG [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/oldWALs 2023-07-15 16:28:00,989 INFO [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43575%2C1689438109937.meta:.meta(num 1689438112516) 2023-07-15 16:28:00,994 DEBUG [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/oldWALs 2023-07-15 16:28:00,994 INFO [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43575%2C1689438109937:(num 1689438112325) 2023-07-15 16:28:00,994 DEBUG [RS:0;jenkins-hbase4:43575] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:28:00,994 INFO [RS:0;jenkins-hbase4:43575] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:28:00,994 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 16:28:00,994 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:28:00,995 INFO [RS:0;jenkins-hbase4:43575] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43575 2023-07-15 16:28:01,003 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43575,1689438109937 2023-07-15 16:28:01,003 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:28:01,004 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:28:01,004 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43575,1689438109937] 2023-07-15 16:28:01,004 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43575,1689438109937; numProcessing=1 2023-07-15 16:28:01,007 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43575,1689438109937 already deleted, retry=false 2023-07-15 16:28:01,007 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43575,1689438109937 expired; onlineServers=0 2023-07-15 16:28:01,007 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36241,1689438108300' ***** 2023-07-15 16:28:01,007 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 16:28:01,007 DEBUG [M:0;jenkins-hbase4:36241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21761a92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:28:01,007 INFO [M:0;jenkins-hbase4:36241] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-15 16:28:01,012 INFO [M:0;jenkins-hbase4:36241] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@277157a4{master,/,null,STOPPED}{file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/master} 2023-07-15 16:28:01,012 INFO [M:0;jenkins-hbase4:36241] server.AbstractConnector(383): Stopped ServerConnector@15a48c61{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-15 16:28:01,012 INFO [M:0;jenkins-hbase4:36241] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-15 16:28:01,012 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 16:28:01,013 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:28:01,013 INFO [M:0;jenkins-hbase4:36241] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@1acd36c9{static,/static,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/classes/hbase-webapps/static/,STOPPED} 2023-07-15 16:28:01,013 INFO [M:0;jenkins-hbase4:36241] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2f974591{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/hadoop.log.dir/,STOPPED} 2023-07-15 16:28:01,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:28:01,014 INFO [M:0;jenkins-hbase4:36241] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36241,1689438108300 2023-07-15 16:28:01,014 INFO [M:0;jenkins-hbase4:36241] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36241,1689438108300; all regions closed. 2023-07-15 16:28:01,014 DEBUG [M:0;jenkins-hbase4:36241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:28:01,014 INFO [M:0;jenkins-hbase4:36241] master.HMaster(1491): Stopping master jetty server 2023-07-15 16:28:01,014 INFO [M:0;jenkins-hbase4:36241] server.AbstractConnector(383): Stopped ServerConnector@46020f33{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-15 16:28:01,015 DEBUG [M:0;jenkins-hbase4:36241] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 16:28:01,015 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 16:28:01,015 DEBUG [M:0;jenkins-hbase4:36241] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 16:28:01,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689438111998] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689438111998,5,FailOnTimeoutGroup] 2023-07-15 16:28:01,015 INFO [M:0;jenkins-hbase4:36241] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 16:28:01,015 INFO [M:0;jenkins-hbase4:36241] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 16:28:01,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689438111998] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689438111998,5,FailOnTimeoutGroup] 2023-07-15 16:28:01,015 INFO [M:0;jenkins-hbase4:36241] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 16:28:01,016 DEBUG [M:0;jenkins-hbase4:36241] master.HMaster(1512): Stopping service threads 2023-07-15 16:28:01,016 INFO [M:0;jenkins-hbase4:36241] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 16:28:01,016 INFO [M:0;jenkins-hbase4:36241] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 16:28:01,017 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 16:28:01,017 DEBUG [M:0;jenkins-hbase4:36241] zookeeper.ZKUtil(398): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 16:28:01,017 WARN [M:0;jenkins-hbase4:36241] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 16:28:01,017 INFO [M:0;jenkins-hbase4:36241] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 16:28:01,017 INFO [M:0;jenkins-hbase4:36241] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 16:28:01,018 DEBUG [M:0;jenkins-hbase4:36241] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 16:28:01,018 INFO [M:0;jenkins-hbase4:36241] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:28:01,018 DEBUG [M:0;jenkins-hbase4:36241] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:28:01,018 DEBUG [M:0;jenkins-hbase4:36241] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 16:28:01,018 DEBUG [M:0;jenkins-hbase4:36241] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:28:01,018 INFO [M:0;jenkins-hbase4:36241] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=95.75 KB heapSize=115.68 KB 2023-07-15 16:28:01,105 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:28:01,105 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43575,1689438109937; zookeeper connection closed. 2023-07-15 16:28:01,105 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x10169ca3a2d0001, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:28:01,106 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@480c5be0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@480c5be0 2023-07-15 16:28:01,106 INFO [Listener at localhost/41149] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-15 16:28:01,434 INFO [M:0;jenkins-hbase4:36241] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=95.75 KB at sequenceid=237 (bloomFilter=true), to=hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1bbaf4742dcb404f8a5634953131f7d0 2023-07-15 16:28:01,440 INFO [M:0;jenkins-hbase4:36241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bbaf4742dcb404f8a5634953131f7d0 2023-07-15 16:28:01,441 DEBUG [M:0;jenkins-hbase4:36241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1bbaf4742dcb404f8a5634953131f7d0 as hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1bbaf4742dcb404f8a5634953131f7d0 2023-07-15 16:28:01,448 INFO [M:0;jenkins-hbase4:36241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bbaf4742dcb404f8a5634953131f7d0 2023-07-15 16:28:01,448 INFO [M:0;jenkins-hbase4:36241] regionserver.HStore(1080): Added hdfs://localhost:39495/user/jenkins/test-data/3e5a295f-6a9c-4e41-f502-eaa2e83ebb72/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1bbaf4742dcb404f8a5634953131f7d0, entries=28, sequenceid=237, filesize=7.7 K 2023-07-15 16:28:01,449 INFO [M:0;jenkins-hbase4:36241] regionserver.HRegion(2948): Finished flush of dataSize ~95.75 KB/98050, heapSize ~115.66 KB/118440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 431ms, sequenceid=237, compaction requested=false 2023-07-15 16:28:01,451 INFO [M:0;jenkins-hbase4:36241] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:28:01,451 DEBUG [M:0;jenkins-hbase4:36241] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:28:01,454 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:28:01,454 INFO [M:0;jenkins-hbase4:36241] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 16:28:01,454 INFO [M:0;jenkins-hbase4:36241] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36241 2023-07-15 16:28:01,456 DEBUG [M:0;jenkins-hbase4:36241] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36241,1689438108300 already deleted, retry=false 2023-07-15 16:28:01,557 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:28:01,557 INFO [M:0;jenkins-hbase4:36241] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36241,1689438108300; zookeeper connection closed. 2023-07-15 16:28:01,557 DEBUG [Listener at localhost/41149-EventThread] zookeeper.ZKWatcher(600): master:36241-0x10169ca3a2d0000, quorum=127.0.0.1:52983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:28:01,559 WARN [Listener at localhost/41149] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 16:28:01,562 INFO [Listener at localhost/41149] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:28:01,666 WARN [BP-1754398799-172.31.14.131-1689438105259 heartbeating to localhost/127.0.0.1:39495] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 16:28:01,666 WARN [BP-1754398799-172.31.14.131-1689438105259 heartbeating to localhost/127.0.0.1:39495] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1754398799-172.31.14.131-1689438105259 (Datanode Uuid 27f5a0f1-7325-4d4d-a42d-01f4cb7e3898) service to localhost/127.0.0.1:39495 2023-07-15 16:28:01,667 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/cluster_edbdb1ca-a970-1c74-ea26-003d07cff7d0/dfs/data/data1/current/BP-1754398799-172.31.14.131-1689438105259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:28:01,667 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/efb42270-bb6e-c171-8430-8cde5916b0c5/cluster_edbdb1ca-a970-1c74-ea26-003d07cff7d0/dfs/data/data2/current/BP-1754398799-172.31.14.131-1689438105259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:28:01,705 INFO [Listener at localhost/41149] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:28:01,816 INFO [Listener at localhost/41149] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 16:28:01,840 INFO [Listener at localhost/41149] hbase.HBaseTestingUtility(1293): Minicluster is down