2023-07-19 05:21:20,177 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe 2023-07-19 05:21:20,296 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestQuotasShell timeout: 13 mins 2023-07-19 05:21:20,412 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 05:21:20,540 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 05:21:20,540 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/cluster_f94bf6a0-4d70-c64f-76a8-aa990e0b75c7, deleteOnExit=true 2023-07-19 05:21:20,540 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 05:21:20,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/test.cache.data in system properties and HBase conf 2023-07-19 05:21:20,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 05:21:20,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/hadoop.log.dir in system properties and HBase conf 2023-07-19 05:21:20,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 05:21:20,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 05:21:20,542 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 05:21:20,815 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 05:21:20,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 05:21:20,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 05:21:20,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 05:21:20,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 05:21:20,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 05:21:20,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 05:21:20,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 05:21:20,822 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 05:21:20,822 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 05:21:20,822 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/nfs.dump.dir in system properties and HBase conf 2023-07-19 05:21:20,822 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/java.io.tmpdir in system properties and HBase conf 2023-07-19 05:21:20,823 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 05:21:20,823 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 05:21:20,823 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 05:21:21,323 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 05:21:21,327 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 05:21:21,604 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 05:21:21,783 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 05:21:21,797 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 05:21:21,832 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 05:21:21,866 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/java.io.tmpdir/Jetty_localhost_42719_hdfs____.5aoc8l/webapp 2023-07-19 05:21:21,996 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42719 2023-07-19 05:21:22,014 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 05:21:22,014 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 05:21:22,552 WARN [Listener at localhost/37249] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 05:21:22,703 WARN [Listener at localhost/37249] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 05:21:22,721 WARN [Listener at localhost/37249] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 05:21:22,729 INFO [Listener at localhost/37249] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 05:21:22,734 INFO [Listener at localhost/37249] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/java.io.tmpdir/Jetty_localhost_33305_datanode____fyo933/webapp 2023-07-19 05:21:22,837 INFO [Listener at localhost/37249] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33305 2023-07-19 05:21:23,036 WARN [Listener at localhost/46177] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 05:21:23,441 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a669c9d132077e4: Processing first storage report for DS-7f47ca41-3c41-41ff-b00f-cb02d2447ccc from datanode 76b78119-ef30-4cdc-9329-b7de5a7bc1eb 2023-07-19 05:21:23,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a669c9d132077e4: from storage DS-7f47ca41-3c41-41ff-b00f-cb02d2447ccc node DatanodeRegistration(127.0.0.1:35705, datanodeUuid=76b78119-ef30-4cdc-9329-b7de5a7bc1eb, infoPort=37075, infoSecurePort=0, ipcPort=46177, storageInfo=lv=-57;cid=testClusterID;nsid=1336735879;c=1689744081402), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 05:21:23,443 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a669c9d132077e4: Processing first storage report for DS-8fde7e5c-ffc1-4a59-bed4-ade25c5210f6 from datanode 76b78119-ef30-4cdc-9329-b7de5a7bc1eb 2023-07-19 05:21:23,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a669c9d132077e4: from storage DS-8fde7e5c-ffc1-4a59-bed4-ade25c5210f6 node DatanodeRegistration(127.0.0.1:35705, datanodeUuid=76b78119-ef30-4cdc-9329-b7de5a7bc1eb, infoPort=37075, infoSecurePort=0, ipcPort=46177, storageInfo=lv=-57;cid=testClusterID;nsid=1336735879;c=1689744081402), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 05:21:23,513 DEBUG [Listener at localhost/46177] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe 2023-07-19 05:21:23,572 INFO [Listener at localhost/46177] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/cluster_f94bf6a0-4d70-c64f-76a8-aa990e0b75c7/zookeeper_0, clientPort=52345, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/cluster_f94bf6a0-4d70-c64f-76a8-aa990e0b75c7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/cluster_f94bf6a0-4d70-c64f-76a8-aa990e0b75c7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 05:21:23,584 INFO [Listener at localhost/46177] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52345 2023-07-19 05:21:23,591 INFO [Listener at localhost/46177] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 05:21:23,593 INFO [Listener at localhost/46177] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 05:21:24,240 INFO [Listener at localhost/46177] util.FSUtils(471): Created version file at hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287 with version=8 2023-07-19 05:21:24,241 INFO [Listener at localhost/46177] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/hbase-staging 2023-07-19 05:21:24,259 DEBUG [Listener at localhost/46177] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-19 05:21:24,259 DEBUG [Listener at localhost/46177] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-19 05:21:24,595 INFO [Listener at localhost/46177] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 05:21:25,074 INFO [Listener at localhost/46177] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=18 2023-07-19 05:21:25,109 INFO [Listener at localhost/46177] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 05:21:25,109 INFO [Listener at localhost/46177] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 05:21:25,109 INFO [Listener at localhost/46177] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 05:21:25,110 INFO [Listener at localhost/46177] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 05:21:25,110 INFO [Listener at localhost/46177] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 05:21:25,253 INFO [Listener at localhost/46177] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 05:21:25,326 DEBUG [Listener at localhost/46177] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 05:21:25,425 INFO [Listener at localhost/46177] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40633 2023-07-19 05:21:25,444 INFO [Listener at localhost/46177] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 05:21:25,446 INFO [Listener at localhost/46177] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 05:21:25,468 INFO [Listener at localhost/46177] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40633 connecting to ZooKeeper ensemble=127.0.0.1:52345 2023-07-19 05:21:25,519 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:406330x0, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 05:21:25,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40633-0x1017c070d690000 connected 2023-07-19 05:21:25,551 DEBUG [Listener at localhost/46177] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 05:21:25,552 DEBUG [Listener at localhost/46177] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 05:21:25,565 DEBUG [Listener at localhost/46177] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 05:21:25,573 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40633 2023-07-19 05:21:25,574 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40633 2023-07-19 05:21:25,574 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40633 2023-07-19 05:21:25,576 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40633 2023-07-19 05:21:25,578 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40633 2023-07-19 05:21:25,616 INFO [Listener at localhost/46177] log.Log(170): Logging initialized @6107ms to org.apache.hbase.thirdparty.org.eclipse.jetty.util.log.Slf4jLog 2023-07-19 05:21:25,739 INFO [Listener at localhost/46177] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-19 05:21:25,740 INFO [Listener at localhost/46177] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-19 05:21:25,741 INFO [Listener at localhost/46177] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-19 05:21:25,743 INFO [Listener at localhost/46177] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-19 05:21:25,743 INFO [Listener at localhost/46177] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-19 05:21:25,743 INFO [Listener at localhost/46177] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-19 05:21:25,747 INFO [Listener at localhost/46177] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-19 05:21:25,806 INFO [Listener at localhost/46177] http.HttpServer(1146): Jetty bound to port 45127 2023-07-19 05:21:25,808 INFO [Listener at localhost/46177] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-19 05:21:25,835 INFO [Listener at localhost/46177] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-19 05:21:25,839 INFO [Listener at localhost/46177] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@39035498{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/hadoop.log.dir/,AVAILABLE} 2023-07-19 05:21:25,839 INFO [Listener at localhost/46177] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-19 05:21:25,839 INFO [Listener at localhost/46177] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@ecbdb00{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-19 05:21:26,006 INFO [Listener at localhost/46177] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-19 05:21:26,018 INFO [Listener at localhost/46177] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-19 05:21:26,018 INFO [Listener at localhost/46177] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-19 05:21:26,020 INFO [Listener at localhost/46177] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-19 05:21:26,026 INFO [Listener at localhost/46177] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-19 05:21:26,053 INFO [Listener at localhost/46177] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@748a1947{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/java.io.tmpdir/jetty-0_0_0_0-45127-hbase-server-2_4_18-SNAPSHOT_jar-_-any-1184698256580125841/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-19 05:21:26,065 INFO [Listener at localhost/46177] server.AbstractConnector(333): Started ServerConnector@5d913362{HTTP/1.1, (http/1.1)}{0.0.0.0:45127} 2023-07-19 05:21:26,066 INFO [Listener at localhost/46177] server.Server(415): Started @6556ms 2023-07-19 05:21:26,069 INFO [Listener at localhost/46177] master.HMaster(444): hbase.rootdir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287, hbase.cluster.distributed=false 2023-07-19 05:21:26,128 INFO [Listener at localhost/46177] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=18 2023-07-19 05:21:26,129 INFO [Listener at localhost/46177] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 05:21:26,129 INFO [Listener at localhost/46177] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 05:21:26,129 INFO [Listener at localhost/46177] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 05:21:26,129 INFO [Listener at localhost/46177] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 05:21:26,129 INFO [Listener at localhost/46177] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 05:21:26,134 INFO [Listener at localhost/46177] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 05:21:26,136 INFO [Listener at localhost/46177] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41069 2023-07-19 05:21:26,139 INFO [Listener at localhost/46177] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 05:21:26,146 DEBUG [Listener at localhost/46177] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 05:21:26,147 INFO [Listener at localhost/46177] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 05:21:26,150 INFO [Listener at localhost/46177] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 05:21:26,151 INFO [Listener at localhost/46177] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41069 connecting to ZooKeeper ensemble=127.0.0.1:52345 2023-07-19 05:21:26,156 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:410690x0, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 05:21:26,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41069-0x1017c070d690001 connected 2023-07-19 05:21:26,157 DEBUG [Listener at localhost/46177] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 05:21:26,158 DEBUG [Listener at localhost/46177] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 05:21:26,159 DEBUG [Listener at localhost/46177] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 05:21:26,159 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41069 2023-07-19 05:21:26,160 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41069 2023-07-19 05:21:26,160 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41069 2023-07-19 05:21:26,160 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41069 2023-07-19 05:21:26,161 DEBUG [Listener at localhost/46177] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41069 2023-07-19 05:21:26,164 INFO [Listener at localhost/46177] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-19 05:21:26,164 INFO [Listener at localhost/46177] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-19 05:21:26,165 INFO [Listener at localhost/46177] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-19 05:21:26,165 INFO [Listener at localhost/46177] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-19 05:21:26,166 INFO [Listener at localhost/46177] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-19 05:21:26,166 INFO [Listener at localhost/46177] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-19 05:21:26,166 INFO [Listener at localhost/46177] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-19 05:21:26,168 INFO [Listener at localhost/46177] http.HttpServer(1146): Jetty bound to port 35715 2023-07-19 05:21:26,168 INFO [Listener at localhost/46177] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-19 05:21:26,170 INFO [Listener at localhost/46177] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-19 05:21:26,170 INFO [Listener at localhost/46177] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@27a05f4c{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/hadoop.log.dir/,AVAILABLE} 2023-07-19 05:21:26,170 INFO [Listener at localhost/46177] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-19 05:21:26,171 INFO [Listener at localhost/46177] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@542f414e{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-19 05:21:26,293 INFO [Listener at localhost/46177] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-19 05:21:26,294 INFO [Listener at localhost/46177] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-19 05:21:26,294 INFO [Listener at localhost/46177] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-19 05:21:26,294 INFO [Listener at localhost/46177] session.HouseKeeper(132): node0 Scavenging every 660000ms 2023-07-19 05:21:26,295 INFO [Listener at localhost/46177] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-19 05:21:26,300 INFO [Listener at localhost/46177] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@3106071a{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/java.io.tmpdir/jetty-0_0_0_0-35715-hbase-server-2_4_18-SNAPSHOT_jar-_-any-2181437020962019400/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-19 05:21:26,301 INFO [Listener at localhost/46177] server.AbstractConnector(333): Started ServerConnector@4401030e{HTTP/1.1, (http/1.1)}{0.0.0.0:35715} 2023-07-19 05:21:26,301 INFO [Listener at localhost/46177] server.Server(415): Started @6792ms 2023-07-19 05:21:26,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-19 05:21:26,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@18cecf30{HTTP/1.1, (http/1.1)}{0.0.0.0:42531} 2023-07-19 05:21:26,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(415): Started @6802ms 2023-07-19 05:21:26,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:21:26,322 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 05:21:26,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:21:26,343 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 05:21:26,343 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 05:21:26,343 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:26,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 05:21:26,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40633,1689744084421 from backup master directory 2023-07-19 05:21:26,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 05:21:26,348 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:21:26,349 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 05:21:26,350 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 05:21:26,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:21:26,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 05:21:26,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 05:21:26,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/hbase.id with ID: 81610c7e-50fb-4bae-9db4-09b95fe8ee37 2023-07-19 05:21:26,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 05:21:26,487 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:26,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x784dbb9e to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:26,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38ba91cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:26,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 05:21:26,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 05:21:26,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 05:21:26,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 05:21:26,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 05:21:26,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 05:21:26,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 05:21:26,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store-tmp 2023-07-19 05:21:27,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:27,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 05:21:27,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 05:21:27,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 05:21:27,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 05:21:27,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 05:21:27,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 05:21:27,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 05:21:27,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/WALs/jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:21:27,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40633%2C1689744084421, suffix=, logDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/WALs/jenkins-hbase4.apache.org,40633,1689744084421, archiveDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/oldWALs, maxLogs=10 2023-07-19 05:21:27,172 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35705,DS-7f47ca41-3c41-41ff-b00f-cb02d2447ccc,DISK] 2023-07-19 05:21:27,180 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 05:21:27,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/WALs/jenkins-hbase4.apache.org,40633,1689744084421/jenkins-hbase4.apache.org%2C40633%2C1689744084421.1689744087131 2023-07-19 05:21:27,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35705,DS-7f47ca41-3c41-41ff-b00f-cb02d2447ccc,DISK]] 2023-07-19 05:21:27,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 05:21:27,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:27,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 05:21:27,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 05:21:27,320 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 05:21:27,326 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 05:21:27,357 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 05:21:27,369 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:27,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 05:21:27,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 05:21:27,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 05:21:27,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 05:21:27,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11137730720, jitterRate=0.037282004952430725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 05:21:27,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 05:21:27,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 05:21:27,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 05:21:27,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 05:21:27,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 05:21:27,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-19 05:21:27,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-19 05:21:27,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 05:21:27,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 05:21:27,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 05:21:27,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 05:21:27,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 05:21:27,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 05:21:27,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 05:21:27,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 05:21:27,557 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:27,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 05:21:27,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 05:21:27,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 05:21:27,577 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 05:21:27,577 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 05:21:27,577 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:27,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40633,1689744084421, sessionid=0x1017c070d690000, setting cluster-up flag (Was=false) 2023-07-19 05:21:27,599 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:27,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 05:21:27,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:21:27,614 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:27,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 05:21:27,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:21:27,624 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp 2023-07-19 05:21:27,706 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(951): ClusterId : 81610c7e-50fb-4bae-9db4-09b95fe8ee37 2023-07-19 05:21:27,713 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 05:21:27,719 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 05:21:27,719 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 05:21:27,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 05:21:27,722 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 05:21:27,723 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ReadOnlyZKClient(139): Connect 0x7f7ae260 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:27,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 05:21:27,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 05:21:27,728 DEBUG [RS:0;jenkins-hbase4:41069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7043e6e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:27,729 DEBUG [RS:0;jenkins-hbase4:41069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11c154b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 05:21:27,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=VisibilityLabelsService 2023-07-19 05:21:27,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870913. 2023-07-19 05:21:27,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870914. 2023-07-19 05:21:27,752 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41069 2023-07-19 05:21:27,757 INFO [RS:0;jenkins-hbase4:41069] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 05:21:27,757 INFO [RS:0;jenkins-hbase4:41069] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 05:21:27,757 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 05:21:27,758 INFO [RS:0;jenkins-hbase4:41069] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 05:21:27,758 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 05:21:27,761 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40633,1689744084421 with isa=jenkins-hbase4.apache.org/172.31.14.131:41069, startcode=1689744086127 2023-07-19 05:21:27,778 DEBUG [RS:0;jenkins-hbase4:41069] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 05:21:27,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 05:21:27,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 05:21:27,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 05:21:27,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 05:21:27,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 05:21:27,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 05:21:27,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:27,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 05:21:27,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:27,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689744117829 2023-07-19 05:21:27,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 05:21:27,832 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37659, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 05:21:27,834 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 05:21:27,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 05:21:27,835 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 05:21:27,841 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40633] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 05:21:27,842 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 05:21:27,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 05:21:27,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 05:21:27,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 05:21:27,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 05:21:27,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:27,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 05:21:27,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 05:21:27,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 05:21:27,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 05:21:27,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 05:21:27,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689744087862,5,FailOnTimeoutGroup] 2023-07-19 05:21:27,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689744087863,5,FailOnTimeoutGroup] 2023-07-19 05:21:27,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:27,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 05:21:27,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:27,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:27,874 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 05:21:27,875 WARN [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 05:21:27,976 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40633,1689744084421 with isa=jenkins-hbase4.apache.org/172.31.14.131:41069, startcode=1689744086127 2023-07-19 05:21:27,981 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40633] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:27,988 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287 2023-07-19 05:21:27,989 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37249 2023-07-19 05:21:27,989 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=45127 2023-07-19 05:21:27,995 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 05:21:27,995 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ZKUtil(162): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:27,995 WARN [RS:0;jenkins-hbase4:41069] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 05:21:27,996 INFO [RS:0;jenkins-hbase4:41069] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 05:21:27,996 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/WALs/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:27,997 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41069,1689744086127] 2023-07-19 05:21:28,005 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ZKUtil(162): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:28,020 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 05:21:28,032 INFO [RS:0;jenkins-hbase4:41069] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 05:21:28,053 INFO [RS:0;jenkins-hbase4:41069] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 05:21:28,057 INFO [RS:0;jenkins-hbase4:41069] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 05:21:28,057 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,058 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 05:21:28,066 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,066 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,067 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,067 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,067 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,067 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,067 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 05:21:28,067 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,067 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,068 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,068 DEBUG [RS:0;jenkins-hbase4:41069] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 05:21:28,069 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,069 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,069 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,069 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,084 INFO [RS:0;jenkins-hbase4:41069] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 05:21:28,086 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41069,1689744086127-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,103 INFO [RS:0;jenkins-hbase4:41069] regionserver.Replication(203): jenkins-hbase4.apache.org,41069,1689744086127 started 2023-07-19 05:21:28,103 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41069,1689744086127, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41069, sessionid=0x1017c070d690001 2023-07-19 05:21:28,103 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 05:21:28,103 DEBUG [RS:0;jenkins-hbase4:41069] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:28,103 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41069,1689744086127' 2023-07-19 05:21:28,103 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 05:21:28,104 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 05:21:28,105 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 05:21:28,105 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 05:21:28,105 DEBUG [RS:0;jenkins-hbase4:41069] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:28,105 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41069,1689744086127' 2023-07-19 05:21:28,105 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 05:21:28,105 DEBUG [RS:0;jenkins-hbase4:41069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 05:21:28,106 DEBUG [RS:0;jenkins-hbase4:41069] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 05:21:28,106 INFO [RS:0;jenkins-hbase4:41069] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-19 05:21:28,108 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,108 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ZKUtil(398): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-19 05:21:28,108 INFO [RS:0;jenkins-hbase4:41069] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-19 05:21:28,109 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,109 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:28,221 INFO [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41069%2C1689744086127, suffix=, logDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/WALs/jenkins-hbase4.apache.org,41069,1689744086127, archiveDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/oldWALs, maxLogs=32 2023-07-19 05:21:28,239 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35705,DS-7f47ca41-3c41-41ff-b00f-cb02d2447ccc,DISK] 2023-07-19 05:21:28,242 INFO [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/WALs/jenkins-hbase4.apache.org,41069,1689744086127/jenkins-hbase4.apache.org%2C41069%2C1689744086127.1689744088224 2023-07-19 05:21:28,243 DEBUG [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35705,DS-7f47ca41-3c41-41ff-b00f-cb02d2447ccc,DISK]] 2023-07-19 05:21:28,283 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 05:21:28,284 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 05:21:28,285 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287 2023-07-19 05:21:28,699 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:28,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 05:21:28,706 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/info 2023-07-19 05:21:28,707 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 05:21:28,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:28,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 05:21:28,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/rep_barrier 2023-07-19 05:21:28,712 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 05:21:28,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:28,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 05:21:28,715 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/table 2023-07-19 05:21:28,716 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 05:21:28,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:28,718 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740 2023-07-19 05:21:28,720 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740 2023-07-19 05:21:28,724 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 05:21:28,727 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 05:21:28,730 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 05:21:28,732 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11574450240, jitterRate=0.07795467972755432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 05:21:28,732 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 05:21:28,733 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 05:21:28,733 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 05:21:28,733 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 05:21:28,733 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 05:21:28,733 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 05:21:28,734 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 05:21:28,734 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 05:21:28,739 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 05:21:28,740 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 05:21:28,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 05:21:28,763 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 05:21:28,766 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 05:21:28,918 DEBUG [jenkins-hbase4:40633] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-19 05:21:28,921 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41069,1689744086127, state=OPENING 2023-07-19 05:21:28,928 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 05:21:28,929 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:28,930 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 05:21:28,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41069,1689744086127}] 2023-07-19 05:21:29,119 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:29,121 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 05:21:29,124 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 05:21:29,135 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 05:21:29,135 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 05:21:29,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41069%2C1689744086127.meta, suffix=.meta, logDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/WALs/jenkins-hbase4.apache.org,41069,1689744086127, archiveDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/oldWALs, maxLogs=32 2023-07-19 05:21:29,161 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35705,DS-7f47ca41-3c41-41ff-b00f-cb02d2447ccc,DISK] 2023-07-19 05:21:29,165 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/WALs/jenkins-hbase4.apache.org,41069,1689744086127/jenkins-hbase4.apache.org%2C41069%2C1689744086127.meta.1689744089140.meta 2023-07-19 05:21:29,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35705,DS-7f47ca41-3c41-41ff-b00f-cb02d2447ccc,DISK]] 2023-07-19 05:21:29,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 05:21:29,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 05:21:29,169 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 05:21:29,169 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=VisibilityLabelsService 2023-07-19 05:21:29,176 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-19 05:21:29,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 05:21:29,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 05:21:29,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 05:21:29,197 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 05:21:29,197 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:29,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 05:21:29,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 05:21:29,201 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 05:21:29,203 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/info 2023-07-19 05:21:29,203 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/info 2023-07-19 05:21:29,204 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 05:21:29,205 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:29,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 05:21:29,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/rep_barrier 2023-07-19 05:21:29,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/rep_barrier 2023-07-19 05:21:29,208 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 05:21:29,209 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:29,209 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 05:21:29,211 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/table 2023-07-19 05:21:29,211 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/table 2023-07-19 05:21:29,212 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 05:21:29,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:29,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740 2023-07-19 05:21:29,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740 2023-07-19 05:21:29,223 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 05:21:29,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 05:21:29,228 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10649557280, jitterRate=-0.008182689547538757}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 05:21:29,237 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:29,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 05:21:29,269 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689744089110 2023-07-19 05:21:29,292 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 05:21:29,293 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 05:21:29,293 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41069,1689744086127, state=OPEN 2023-07-19 05:21:29,301 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 05:21:29,301 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 05:21:29,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 05:21:29,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41069,1689744086127 in 368 msec 2023-07-19 05:21:29,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 05:21:29,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 556 msec 2023-07-19 05:21:29,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5700 sec 2023-07-19 05:21:29,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689744089315, completionTime=-1 2023-07-19 05:21:29,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-19 05:21:29,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 05:21:29,382 DEBUG [hconnection-0x671f8795-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:29,386 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:29,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-19 05:21:29,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689744149414 2023-07-19 05:21:29,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689744209414 2023-07-19 05:21:29,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 97 msec 2023-07-19 05:21:29,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40633,1689744084421-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:29,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40633,1689744084421-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:29,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40633,1689744084421-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:29,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40633, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:29,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:29,448 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 05:21:29,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 05:21:29,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 05:21:29,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 05:21:29,469 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 05:21:29,475 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 05:21:29,503 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/namespace/7423337174813689edb9c40059b88fb0 2023-07-19 05:21:29,506 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/namespace/7423337174813689edb9c40059b88fb0 empty. 2023-07-19 05:21:29,507 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/namespace/7423337174813689edb9c40059b88fb0 2023-07-19 05:21:29,507 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 05:21:29,935 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 05:21:29,939 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7423337174813689edb9c40059b88fb0, NAME => 'hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp 2023-07-19 05:21:30,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:30,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7423337174813689edb9c40059b88fb0, disabling compactions & flushes 2023-07-19 05:21:30,354 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:21:30,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:21:30,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. after waiting 0 ms 2023-07-19 05:21:30,354 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:21:30,355 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:21:30,355 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7423337174813689edb9c40059b88fb0: 2023-07-19 05:21:30,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 05:21:30,376 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689744090363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689744090363"}]},"ts":"1689744090363"} 2023-07-19 05:21:30,403 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 05:21:30,405 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 05:21:30,409 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744090405"}]},"ts":"1689744090405"} 2023-07-19 05:21:30,414 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 05:21:30,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7423337174813689edb9c40059b88fb0, ASSIGN}] 2023-07-19 05:21:30,423 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7423337174813689edb9c40059b88fb0, ASSIGN 2023-07-19 05:21:30,425 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7423337174813689edb9c40059b88fb0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41069,1689744086127; forceNewPlan=false, retain=false 2023-07-19 05:21:30,576 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7423337174813689edb9c40059b88fb0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:30,576 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689744090576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689744090576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689744090576"}]},"ts":"1689744090576"} 2023-07-19 05:21:30,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7423337174813689edb9c40059b88fb0, server=jenkins-hbase4.apache.org,41069,1689744086127}] 2023-07-19 05:21:30,741 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:21:30,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7423337174813689edb9c40059b88fb0, NAME => 'hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0.', STARTKEY => '', ENDKEY => ''} 2023-07-19 05:21:30,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. service=AccessControlService 2023-07-19 05:21:30,743 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 05:21:30,743 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. service=VisibilityLabelsService 2023-07-19 05:21:30,743 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-19 05:21:30,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7423337174813689edb9c40059b88fb0 2023-07-19 05:21:30,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:30,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7423337174813689edb9c40059b88fb0 2023-07-19 05:21:30,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7423337174813689edb9c40059b88fb0 2023-07-19 05:21:30,746 INFO [StoreOpener-7423337174813689edb9c40059b88fb0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7423337174813689edb9c40059b88fb0 2023-07-19 05:21:30,748 DEBUG [StoreOpener-7423337174813689edb9c40059b88fb0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0/info 2023-07-19 05:21:30,748 DEBUG [StoreOpener-7423337174813689edb9c40059b88fb0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0/info 2023-07-19 05:21:30,749 INFO [StoreOpener-7423337174813689edb9c40059b88fb0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7423337174813689edb9c40059b88fb0 columnFamilyName info 2023-07-19 05:21:30,750 INFO [StoreOpener-7423337174813689edb9c40059b88fb0-1] regionserver.HStore(310): Store=7423337174813689edb9c40059b88fb0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:30,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0 2023-07-19 05:21:30,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0 2023-07-19 05:21:30,757 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7423337174813689edb9c40059b88fb0 2023-07-19 05:21:30,761 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 05:21:30,762 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7423337174813689edb9c40059b88fb0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11184694560, jitterRate=0.041655853390693665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 05:21:30,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7423337174813689edb9c40059b88fb0: 2023-07-19 05:21:30,764 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0., pid=6, masterSystemTime=1689744090734 2023-07-19 05:21:30,769 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:21:30,769 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:21:30,771 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7423337174813689edb9c40059b88fb0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:30,771 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689744090770"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689744090770"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689744090770"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689744090770"}]},"ts":"1689744090770"} 2023-07-19 05:21:30,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 05:21:30,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7423337174813689edb9c40059b88fb0, server=jenkins-hbase4.apache.org,41069,1689744086127 in 196 msec 2023-07-19 05:21:30,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 05:21:30,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7423337174813689edb9c40059b88fb0, ASSIGN in 360 msec 2023-07-19 05:21:30,786 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 05:21:30,786 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744090786"}]},"ts":"1689744090786"} 2023-07-19 05:21:30,790 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 05:21:30,793 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 05:21:30,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3350 sec 2023-07-19 05:21:30,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 05:21:30,873 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 05:21:30,873 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:30,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 05:21:30,928 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 05:21:30,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-19 05:21:30,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 05:21:30,947 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 05:21:30,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-07-19 05:21:30,962 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 05:21:30,966 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 05:21:30,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.616sec 2023-07-19 05:21:30,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2023-07-19 05:21:30,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 05:21:30,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2023-07-19 05:21:30,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2023-07-19 05:21:30,972 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 05:21:30,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2023-07-19 05:21:30,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 05:21:30,976 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:30,977 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4 empty. 2023-07-19 05:21:30,979 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:30,979 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2023-07-19 05:21:30,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2023-07-19 05:21:30,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2023-07-19 05:21:30,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:30,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 05:21:30,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 05:21:30,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 05:21:30,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40633,1689744084421-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 05:21:30,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40633,1689744084421-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 05:21:31,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 05:21:31,012 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x0d1815e1 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:31,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 05:21:31,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 05:21:31,053 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26ccf5f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:31,056 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 05:21:31,060 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 10 2023-07-19 05:21:31,062 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd empty. 2023-07-19 05:21:31,063 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 05:21:31,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-19 05:21:31,071 DEBUG [hconnection-0x5c26d14a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:31,087 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:31,090 INFO [Listener at localhost/46177] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:21:31,090 DEBUG [Listener at localhost/46177] client.AbstractTestShell(63): Configure jruby runtime, cluster set to org.apache.hadoop.hbase.HBaseTestingUtility@38fb966d 2023-07-19 05:21:31,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-19 05:21:31,396 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2023-07-19 05:21:31,399 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9f4af27c17981ba6f64c8eb72cdea6f4, NAME => 'hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp 2023-07-19 05:21:31,415 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:31,416 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 9f4af27c17981ba6f64c8eb72cdea6f4, disabling compactions & flushes 2023-07-19 05:21:31,416 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:21:31,416 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:21:31,416 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. after waiting 0 ms 2023-07-19 05:21:31,416 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:21:31,416 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:21:31,416 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 9f4af27c17981ba6f64c8eb72cdea6f4: 2023-07-19 05:21:31,421 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 05:21:31,423 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689744091422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689744091422"}]},"ts":"1689744091422"} 2023-07-19 05:21:31,425 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 05:21:31,427 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 05:21:31,427 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744091427"}]},"ts":"1689744091427"} 2023-07-19 05:21:31,430 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2023-07-19 05:21:31,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=9f4af27c17981ba6f64c8eb72cdea6f4, ASSIGN}] 2023-07-19 05:21:31,437 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=9f4af27c17981ba6f64c8eb72cdea6f4, ASSIGN 2023-07-19 05:21:31,439 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=9f4af27c17981ba6f64c8eb72cdea6f4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41069,1689744086127; forceNewPlan=false, retain=false 2023-07-19 05:21:31,490 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 05:21:31,492 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 336bb3bcc81b85a0e86f21bf4a9879bd, NAME => 'hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp 2023-07-19 05:21:31,519 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:31,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 336bb3bcc81b85a0e86f21bf4a9879bd, disabling compactions & flushes 2023-07-19 05:21:31,520 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:21:31,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:21:31,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. after waiting 0 ms 2023-07-19 05:21:31,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:21:31,520 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:21:31,520 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 336bb3bcc81b85a0e86f21bf4a9879bd: 2023-07-19 05:21:31,526 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 05:21:31,529 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689744091529"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689744091529"}]},"ts":"1689744091529"} 2023-07-19 05:21:31,532 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 05:21:31,534 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 05:21:31,534 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744091534"}]},"ts":"1689744091534"} 2023-07-19 05:21:31,537 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 05:21:31,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=336bb3bcc81b85a0e86f21bf4a9879bd, ASSIGN}] 2023-07-19 05:21:31,549 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=336bb3bcc81b85a0e86f21bf4a9879bd, ASSIGN 2023-07-19 05:21:31,552 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=336bb3bcc81b85a0e86f21bf4a9879bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41069,1689744086127; forceNewPlan=false, retain=false 2023-07-19 05:21:31,554 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9f4af27c17981ba6f64c8eb72cdea6f4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:31,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689744091554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689744091554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689744091554"}]},"ts":"1689744091554"} 2023-07-19 05:21:31,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=336bb3bcc81b85a0e86f21bf4a9879bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:31,557 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689744091557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689744091557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689744091557"}]},"ts":"1689744091557"} 2023-07-19 05:21:31,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=11, state=RUNNABLE; OpenRegionProcedure 9f4af27c17981ba6f64c8eb72cdea6f4, server=jenkins-hbase4.apache.org,41069,1689744086127}] 2023-07-19 05:21:31,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=12, state=RUNNABLE; OpenRegionProcedure 336bb3bcc81b85a0e86f21bf4a9879bd, server=jenkins-hbase4.apache.org,41069,1689744086127}] 2023-07-19 05:21:31,720 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:21:31,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 336bb3bcc81b85a0e86f21bf4a9879bd, NAME => 'hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd.', STARTKEY => '', ENDKEY => ''} 2023-07-19 05:21:31,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. service=AccessControlService 2023-07-19 05:21:31,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 05:21:31,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. service=VisibilityLabelsService 2023-07-19 05:21:31,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-19 05:21:31,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:31,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,723 INFO [StoreOpener-336bb3bcc81b85a0e86f21bf4a9879bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,726 DEBUG [StoreOpener-336bb3bcc81b85a0e86f21bf4a9879bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd/l 2023-07-19 05:21:31,726 DEBUG [StoreOpener-336bb3bcc81b85a0e86f21bf4a9879bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd/l 2023-07-19 05:21:31,727 INFO [StoreOpener-336bb3bcc81b85a0e86f21bf4a9879bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 336bb3bcc81b85a0e86f21bf4a9879bd columnFamilyName l 2023-07-19 05:21:31,728 INFO [StoreOpener-336bb3bcc81b85a0e86f21bf4a9879bd-1] regionserver.HStore(310): Store=336bb3bcc81b85a0e86f21bf4a9879bd/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:31,731 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,737 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:21:31,743 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 05:21:31,744 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 336bb3bcc81b85a0e86f21bf4a9879bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11659224480, jitterRate=0.08584989607334137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 05:21:31,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 336bb3bcc81b85a0e86f21bf4a9879bd: 2023-07-19 05:21:31,746 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd., pid=14, masterSystemTime=1689744091713 2023-07-19 05:21:31,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:21:31,750 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:21:31,750 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:21:31,751 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f4af27c17981ba6f64c8eb72cdea6f4, NAME => 'hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4.', STARTKEY => '', ENDKEY => ''} 2023-07-19 05:21:31,751 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. service=AccessControlService 2023-07-19 05:21:31,751 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 05:21:31,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. service=VisibilityLabelsService 2023-07-19 05:21:31,752 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-19 05:21:31,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:31,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:31,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:31,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:31,751 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=336bb3bcc81b85a0e86f21bf4a9879bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:31,753 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689744091751"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689744091751"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689744091751"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689744091751"}]},"ts":"1689744091751"} 2023-07-19 05:21:31,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-19 05:21:31,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; OpenRegionProcedure 336bb3bcc81b85a0e86f21bf4a9879bd, server=jenkins-hbase4.apache.org,41069,1689744086127 in 196 msec 2023-07-19 05:21:31,767 INFO [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:31,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-07-19 05:21:31,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=336bb3bcc81b85a0e86f21bf4a9879bd, ASSIGN in 224 msec 2023-07-19 05:21:31,773 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 05:21:31,774 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744091773"}]},"ts":"1689744091773"} 2023-07-19 05:21:31,776 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 05:21:31,778 DEBUG [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/q 2023-07-19 05:21:31,779 DEBUG [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/q 2023-07-19 05:21:31,779 INFO [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f4af27c17981ba6f64c8eb72cdea6f4 columnFamilyName q 2023-07-19 05:21:31,780 INFO [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] regionserver.HStore(310): Store=9f4af27c17981ba6f64c8eb72cdea6f4/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:31,781 INFO [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:31,781 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 05:21:31,784 DEBUG [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/u 2023-07-19 05:21:31,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=hbase:acl in 769 msec 2023-07-19 05:21:31,784 DEBUG [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/u 2023-07-19 05:21:31,785 INFO [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f4af27c17981ba6f64c8eb72cdea6f4 columnFamilyName u 2023-07-19 05:21:31,786 INFO [StoreOpener-9f4af27c17981ba6f64c8eb72cdea6f4-1] regionserver.HStore(310): Store=9f4af27c17981ba6f64c8eb72cdea6f4/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:31,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:31,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:31,793 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-19 05:21:31,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:21:31,805 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 05:21:31,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-19 05:21:31,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 10 completed 2023-07-19 05:21:31,924 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f4af27c17981ba6f64c8eb72cdea6f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9695771680, jitterRate=-0.09701089560985565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-19 05:21:31,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f4af27c17981ba6f64c8eb72cdea6f4: 2023-07-19 05:21:31,926 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4., pid=13, masterSystemTime=1689744091713 2023-07-19 05:21:31,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 05:21:31,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:labels 2023-07-19 05:21:31,930 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9f4af27c17981ba6f64c8eb72cdea6f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:31,932 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689744091930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689744091930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689744091930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689744091930"}]},"ts":"1689744091930"} 2023-07-19 05:21:31,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:21:31,932 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:21:31,933 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 05:21:31,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "labels" procId is: 15 2023-07-19 05:21:31,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-19 05:21:31,934 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 05:21:31,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=11 2023-07-19 05:21:31,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=11, state=SUCCESS; OpenRegionProcedure 9f4af27c17981ba6f64c8eb72cdea6f4, server=jenkins-hbase4.apache.org,41069,1689744086127 in 377 msec 2023-07-19 05:21:31,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=9 2023-07-19 05:21:31,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=9f4af27c17981ba6f64c8eb72cdea6f4, ASSIGN in 505 msec 2023-07-19 05:21:31,945 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:31,945 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 05:21:31,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744091946"}]},"ts":"1689744091946"} 2023-07-19 05:21:31,946 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066 empty. 2023-07-19 05:21:31,947 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:31,947 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:labels regions 2023-07-19 05:21:31,948 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2023-07-19 05:21:31,952 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 05:21:31,958 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey hbase:quota jenkins.hfs.0: RWXCA 2023-07-19 05:21:31,982 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41069] access.PermissionStorage(611): Read acl: entry[hbase:quota], kv [jenkins.hfs.0: RWXCA] 2023-07-19 05:21:32,020 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 05:21:32,020 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 05:21:32,020 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:21:32,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:quota with data PBUF\x0A/\x0A\x0Djenkins.hfs.0\x12\x1E\x08\x03"\x1A\x0A\x0E\x0A\x05hbase\x12\x05quota \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:32,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:quota with data PBUF\x0A/\x0A\x0Djenkins.hfs.0\x12\x1E\x08\x03"\x1A\x0A\x0E\x0A\x05hbase\x12\x05quota \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:32,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 1.0570 sec 2023-07-19 05:21:32,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-19 05:21:32,369 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/hbase/labels/.tabledesc/.tableinfo.0000000001 2023-07-19 05:21:32,371 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb042bb445aa4cb737b5c2b4232e6066, NAME => 'hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp 2023-07-19 05:21:32,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-19 05:21:32,795 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(866): Instantiated hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:32,796 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1604): Closing bb042bb445aa4cb737b5c2b4232e6066, disabling compactions & flushes 2023-07-19 05:21:32,796 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1626): Closing region hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:21:32,796 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:21:32,796 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. after waiting 0 ms 2023-07-19 05:21:32,796 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:21:32,796 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1838): Closed hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:21:32,796 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1558): Region close journal for bb042bb445aa4cb737b5c2b4232e6066: 2023-07-19 05:21:32,801 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 05:21:32,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689744092804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689744092804"}]},"ts":"1689744092804"} 2023-07-19 05:21:32,807 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 05:21:32,809 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 05:21:32,809 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744092809"}]},"ts":"1689744092809"} 2023-07-19 05:21:32,811 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLING in hbase:meta 2023-07-19 05:21:32,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=bb042bb445aa4cb737b5c2b4232e6066, ASSIGN}] 2023-07-19 05:21:32,820 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=bb042bb445aa4cb737b5c2b4232e6066, ASSIGN 2023-07-19 05:21:32,821 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:labels, region=bb042bb445aa4cb737b5c2b4232e6066, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41069,1689744086127; forceNewPlan=false, retain=false 2023-07-19 05:21:32,973 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bb042bb445aa4cb737b5c2b4232e6066, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:32,973 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689744092972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689744092972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689744092972"}]},"ts":"1689744092972"} 2023-07-19 05:21:32,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure bb042bb445aa4cb737b5c2b4232e6066, server=jenkins-hbase4.apache.org,41069,1689744086127}] 2023-07-19 05:21:33,135 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:21:33,135 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb042bb445aa4cb737b5c2b4232e6066, NAME => 'hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066.', STARTKEY => '', ENDKEY => ''} 2023-07-19 05:21:33,136 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. service=AccessControlService 2023-07-19 05:21:33,136 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 05:21:33,136 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. service=VisibilityLabelsService 2023-07-19 05:21:33,136 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-19 05:21:33,136 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table labels bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:33,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:33,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:33,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:33,139 INFO [StoreOpener-bb042bb445aa4cb737b5c2b4232e6066-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:33,141 DEBUG [StoreOpener-bb042bb445aa4cb737b5c2b4232e6066-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066/f 2023-07-19 05:21:33,141 DEBUG [StoreOpener-bb042bb445aa4cb737b5c2b4232e6066-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066/f 2023-07-19 05:21:33,142 INFO [StoreOpener-bb042bb445aa4cb737b5c2b4232e6066-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb042bb445aa4cb737b5c2b4232e6066 columnFamilyName f 2023-07-19 05:21:33,142 INFO [StoreOpener-bb042bb445aa4cb737b5c2b4232e6066-1] regionserver.HStore(310): Store=bb042bb445aa4cb737b5c2b4232e6066/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:33,144 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:33,145 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:33,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:21:33,156 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 05:21:33,157 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb042bb445aa4cb737b5c2b4232e6066; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@520b03a3, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 05:21:33,172 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2023-07-19 05:21:33,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb042bb445aa4cb737b5c2b4232e6066: 2023-07-19 05:21:33,173 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066., pid=17, masterSystemTime=1689744093129 2023-07-19 05:21:33,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(686): ZK sync() operation took 4ms 2023-07-19 05:21:33,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:21:33,176 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:21:33,177 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bb042bb445aa4cb737b5c2b4232e6066, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:33,177 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689744093177"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689744093177"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689744093177"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689744093177"}]},"ts":"1689744093177"} 2023-07-19 05:21:33,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-19 05:21:33,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure bb042bb445aa4cb737b5c2b4232e6066, server=jenkins-hbase4.apache.org,41069,1689744086127 in 204 msec 2023-07-19 05:21:33,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-19 05:21:33,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=hbase:labels, region=bb042bb445aa4cb737b5c2b4232e6066, ASSIGN in 366 msec 2023-07-19 05:21:33,187 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 05:21:33,187 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744093187"}]},"ts":"1689744093187"} 2023-07-19 05:21:33,189 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLED in hbase:meta 2023-07-19 05:21:33,192 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 05:21:33,193 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey hbase:labels jenkins.hfs.0: RWXCA 2023-07-19 05:21:33,195 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41069] access.PermissionStorage(611): Read acl: entry[hbase:labels], kv [jenkins.hfs.0: RWXCA] 2023-07-19 05:21:33,197 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 05:21:33,197 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 05:21:33,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:33,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:quota with data PBUF\x0A/\x0A\x0Djenkins.hfs.0\x12\x1E\x08\x03"\x1A\x0A\x0E\x0A\x05hbase\x12\x05quota \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:33,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:33,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:quota with data PBUF\x0A/\x0A\x0Djenkins.hfs.0\x12\x1E\x08\x03"\x1A\x0A\x0E\x0A\x05hbase\x12\x05quota \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:33,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; CreateTableProcedure table=hbase:labels in 1.2720 sec 2023-07-19 05:21:33,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-19 05:21:33,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:labels, procId: 15 completed 2023-07-19 05:21:33,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 05:21:34,029 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 05:21:34,031 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 05:21:34,033 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:labels' 2023-07-19 05:21:34,034 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 05:21:34,035 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2023-07-19 05:21:34,339 INFO [Listener at localhost/46177] hbase.ResourceChecker(147): before: client.TestQuotasShell#testRunShellTests Thread=239, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=136, ProcessCount=173, AvailableMemoryMB=5492 2023-07-19 05:21:34,341 INFO [Listener at localhost/46177] client.AbstractTestShell(93): Starting ruby tests. includes: quotas_test.rb excludes: 2023-07-19 05:21:34,729 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-19 05:21:34,841 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:21:34,842 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 05:21:34,842 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:21:34,843 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase RegionObservers 2023-07-19 05:21:34,843 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:21:34,843 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 05:21:34,843 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:21:34,843 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 05:21:34,844 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 05:21:34,844 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 05:21:34,844 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-19 05:21:34,844 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2023-07-19 05:21:34,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 05:21:34,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 05:21:34,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:21:34,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase MasterObservers Ruby description: jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 25.362-b09 on 1.8.0_362-b09 +jit [linux-x86_64] uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag Running tests... Skip commands_test.rb because of not included Skip formatter_test.rb because of not included Skip converter_test.rb because of not included Skip list_locks_test.rb because of not included Skip list_procedures_test.rb because of not included Skip rsgroup_shell_test.rb because of not included Skip noninteractive_test.rb because of not included Skip shell_test.rb because of not included Skip table_test.rb because of not included Skip admin2_test.rb because of not included Skip hbase_test.rb because of not included Skip taskmonitor_test.rb because of not included Skip admin_test.rb because of not included Skip replication_admin_test.rb because of not included loading test file 'quotas_test.rb'. Skip security_admin_test.rb because of not included Skip visibility_labels_admin_test.rb because of not included Loaded suite src/test/ruby/tests_runner Started 2023-07-19 05:21:37,171 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x70add1e5 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:37,191 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1790577a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:37,224 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:37,229 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:37,244 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:21:37,257 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 05:21:37,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 05:21:37,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase_shell_quota_tests_table 2023-07-19 05:21:37,270 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 05:21:37,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "hbase_shell_quota_tests_table" procId is: 18 2023-07-19 05:21:37,273 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 05:21:37,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-19 05:21:37,291 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:37,292 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa empty. 2023-07-19 05:21:37,294 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:37,294 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase_shell_quota_tests_table regions 2023-07-19 05:21:37,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-19 05:21:37,719 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp/data/default/hbase_shell_quota_tests_table/.tabledesc/.tableinfo.0000000001 2023-07-19 05:21:37,721 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(7675): creating {ENCODED => eb949a69bbc58b8d725f0308895bbaaa, NAME => 'hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.tmp 2023-07-19 05:21:38,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-19 05:21:38,135 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:38,135 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1604): Closing eb949a69bbc58b8d725f0308895bbaaa, disabling compactions & flushes 2023-07-19 05:21:38,136 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:38,136 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:38,136 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. after waiting 0 ms 2023-07-19 05:21:38,136 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:38,136 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:38,136 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1558): Region close journal for eb949a69bbc58b8d725f0308895bbaaa: 2023-07-19 05:21:38,140 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 05:21:38,142 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689744098142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689744098142"}]},"ts":"1689744098142"} 2023-07-19 05:21:38,145 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 05:21:38,146 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 05:21:38,146 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744098146"}]},"ts":"1689744098146"} 2023-07-19 05:21:38,148 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLING in hbase:meta 2023-07-19 05:21:38,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=eb949a69bbc58b8d725f0308895bbaaa, ASSIGN}] 2023-07-19 05:21:38,156 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=eb949a69bbc58b8d725f0308895bbaaa, ASSIGN 2023-07-19 05:21:38,157 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=eb949a69bbc58b8d725f0308895bbaaa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41069,1689744086127; forceNewPlan=false, retain=false 2023-07-19 05:21:38,308 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=eb949a69bbc58b8d725f0308895bbaaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:38,309 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689744098308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689744098308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689744098308"}]},"ts":"1689744098308"} 2023-07-19 05:21:38,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure eb949a69bbc58b8d725f0308895bbaaa, server=jenkins-hbase4.apache.org,41069,1689744086127}] 2023-07-19 05:21:38,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb949a69bbc58b8d725f0308895bbaaa, NAME => 'hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.', STARTKEY => '', ENDKEY => ''} 2023-07-19 05:21:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. service=AccessControlService 2023-07-19 05:21:38,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 05:21:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. service=VisibilityLabelsService 2023-07-19 05:21:38,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-19 05:21:38,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table hbase_shell_quota_tests_table eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:38,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 05:21:38,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:38,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:38,475 INFO [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family x of region eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:38,477 DEBUG [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x 2023-07-19 05:21:38,477 DEBUG [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x 2023-07-19 05:21:38,478 INFO [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb949a69bbc58b8d725f0308895bbaaa columnFamilyName x 2023-07-19 05:21:38,479 INFO [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] regionserver.HStore(310): Store=eb949a69bbc58b8d725f0308895bbaaa/x, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:38,479 INFO [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family y of region eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:38,483 DEBUG [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/y 2023-07-19 05:21:38,483 DEBUG [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/y 2023-07-19 05:21:38,484 INFO [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb949a69bbc58b8d725f0308895bbaaa columnFamilyName y 2023-07-19 05:21:38,484 INFO [StoreOpener-eb949a69bbc58b8d725f0308895bbaaa-1] regionserver.HStore(310): Store=eb949a69bbc58b8d725f0308895bbaaa/y, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 05:21:38,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:38,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:38,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase_shell_quota_tests_table descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-19 05:21:38,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:21:38,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 05:21:38,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eb949a69bbc58b8d725f0308895bbaaa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10041156320, jitterRate=-0.06484444439411163}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-19 05:21:38,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eb949a69bbc58b8d725f0308895bbaaa: 2023-07-19 05:21:38,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa., pid=20, masterSystemTime=1689744098464 2023-07-19 05:21:38,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:38,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:38,509 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=eb949a69bbc58b8d725f0308895bbaaa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:38,509 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689744098509"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689744098509"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689744098509"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689744098509"}]},"ts":"1689744098509"} 2023-07-19 05:21:38,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-19 05:21:38,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure eb949a69bbc58b8d725f0308895bbaaa, server=jenkins-hbase4.apache.org,41069,1689744086127 in 201 msec 2023-07-19 05:21:38,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=18 2023-07-19 05:21:38,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=eb949a69bbc58b8d725f0308895bbaaa, ASSIGN in 360 msec 2023-07-19 05:21:38,519 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 05:21:38,519 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689744098519"}]},"ts":"1689744098519"} 2023-07-19 05:21:38,522 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLED in hbase:meta 2023-07-19 05:21:38,525 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 05:21:38,525 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey hbase_shell_quota_tests_table jenkins: RWXCA 2023-07-19 05:21:38,528 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41069] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-19 05:21:38,530 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 05:21:38,530 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 05:21:38,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:38,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:38,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:38,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:38,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:quota with data PBUF\x0A/\x0A\x0Djenkins.hfs.0\x12\x1E\x08\x03"\x1A\x0A\x0E\x0A\x05hbase\x12\x05quota \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:38,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:quota with data PBUF\x0A/\x0A\x0Djenkins.hfs.0\x12\x1E\x08\x03"\x1A\x0A\x0E\x0A\x05hbase\x12\x05quota \x00 \x01 \x02 \x03 \x04 2023-07-19 05:21:38,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; CreateTableProcedure table=hbase_shell_quota_tests_table in 1.2690 sec 2023-07-19 05:21:38,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-19 05:21:38,782 INFO [Listener at localhost/46177] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:hbase_shell_quota_tests_table, procId: 18 completed Created table hbase_shell_quota_tests_table Took 1.5508 seconds Took 0.0377 seconds 2023-07-19 05:21:38,880 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x1ddbb3d7 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:38,886 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48ddbb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:38,889 DEBUG [hconnection-0x45da0bdd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:38,891 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:38,902 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ddbb3d7 to 127.0.0.1:52345 2023-07-19 05:21:38,903 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0067 seconds 2023-07-19 05:21:38,915 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x41bd1995 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:38,919 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a44fb41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:38,922 DEBUG [hconnection-0x32bccd57-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:38,925 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:38,931 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41bd1995 to 127.0.0.1:52345 2023-07-19 05:21:38,932 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0081 seconds 2023-07-19 05:21:38,943 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x2a1b3779 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:38,948 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ca1f302, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:38,951 DEBUG [hconnection-0x15fc3e86-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:38,954 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:38,960 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a1b3779 to 127.0.0.1:52345 2023-07-19 05:21:38,960 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:38,963 INFO [Listener at localhost/46177] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:21:38,963 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70add1e5 to 127.0.0.1:52345 2023-07-19 05:21:38,964 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:21:38,967 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x174e3a49 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:38,972 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2587a877, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:38,975 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:38,978 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:38,992 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:21:38,995 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0159 seconds 2023-07-19 05:21:39,002 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x1f50775e to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,025 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dc91a25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,028 DEBUG [hconnection-0x3f55ed02-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,030 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,038 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f50775e to 127.0.0.1:52345 2023-07-19 05:21:39,038 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0084 seconds 2023-07-19 05:21:39,050 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x6cb0c4b8 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,054 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fb73712, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,056 DEBUG [hconnection-0x12b785e5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,059 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,065 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cb0c4b8 to 127.0.0.1:52345 2023-07-19 05:21:39,066 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:39,068 INFO [Listener at localhost/46177] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:21:39,069 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x174e3a49 to 127.0.0.1:52345 2023-07-19 05:21:39,069 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:21:39,071 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x6cb7fa41 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,081 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56db69b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,084 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,087 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,093 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:21:39,097 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0111 seconds 2023-07-19 05:21:39,104 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x7e57940a to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,114 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2de11c73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,117 DEBUG [hconnection-0x20fa4ebb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,119 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,124 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e57940a to 127.0.0.1:52345 2023-07-19 05:21:39,125 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0050 seconds 2023-07-19 05:21:39,134 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x19e34ec9 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,139 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b8b74a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,230 DEBUG [hconnection-0x8da307-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,235 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,243 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19e34ec9 to 127.0.0.1:52345 2023-07-19 05:21:39,244 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0059 seconds 2023-07-19 05:21:39,254 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x23f4beae to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,261 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35ba0d57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,264 DEBUG [hconnection-0x4b1025-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,267 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,272 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23f4beae to 127.0.0.1:52345 2023-07-19 05:21:39,272 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:39,274 INFO [Listener at localhost/46177] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:21:39,274 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cb7fa41 to 127.0.0.1:52345 2023-07-19 05:21:39,274 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:21:39,276 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x1bdd0dae to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,287 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48389535, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,380 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,383 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,389 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:21:39,392 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0097 seconds 2023-07-19 05:21:39,400 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x6311b3ad to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,405 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@616bef06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,409 DEBUG [hconnection-0x319fec47-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,413 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,421 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6311b3ad to 127.0.0.1:52345 2023-07-19 05:21:39,421 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0069 seconds 2023-07-19 05:21:39,432 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x108c4cb5 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,442 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@331b06a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,526 DEBUG [hconnection-0x5b419fba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,529 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,535 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x108c4cb5 to 127.0.0.1:52345 2023-07-19 05:21:39,535 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:39,537 INFO [Listener at localhost/46177] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:21:39,537 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bdd0dae to 127.0.0.1:52345 2023-07-19 05:21:39,538 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:21:39,541 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x66eb96be to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,548 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5267e81c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,551 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,552 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,557 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:21:39,559 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0076 seconds 2023-07-19 05:21:39,565 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x02ee7638 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,570 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@388a4ebd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,573 DEBUG [hconnection-0x55c066b8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,575 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,582 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02ee7638 to 127.0.0.1:52345 2023-07-19 05:21:39,582 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0061 seconds 2023-07-19 05:21:39,594 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x6c3e6c65 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,601 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24a15f36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,689 DEBUG [hconnection-0x20f50e0f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,691 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,698 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c3e6c65 to 127.0.0.1:52345 2023-07-19 05:21:39,699 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:39,701 INFO [Listener at localhost/46177] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:21:39,701 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66eb96be to 127.0.0.1:52345 2023-07-19 05:21:39,702 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:21:39,711 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x41e7c3e5 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:39,716 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d432019, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:39,721 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:39,723 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:39,731 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:21:39,734 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0116 seconds 2023-07-19 05:21:39,765 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:21:39,768 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService Took 0.0266 seconds Took 0.0030 seconds Took 0.0026 seconds Took 0.0023 seconds Took 0.0023 seconds Took 0.0021 seconds Took 0.0021 seconds Took 0.0023 seconds Took 0.0020 seconds Took 0.0021 seconds 2023-07-19 05:21:39,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-19 05:21:39,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-19 05:21:39,843 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-19 05:21:39,843 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-19 05:21:39,843 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-19 05:21:39,843 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-19 05:21:39,844 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:39,844 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:39,847 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-19 05:21:39,847 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:39,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-19 05:21:39,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 05:21:39,847 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:39,847 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 05:21:39,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:39,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:39,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-19 05:21:39,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:39,849 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-19 05:21:39,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-19 05:21:39,853 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-19 05:21:39,853 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-19 05:21:39,853 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-19 05:21:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-19 05:21:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-19 05:21:39,854 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:39,854 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. started... 2023-07-19 05:21:39,856 INFO [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eb949a69bbc58b8d725f0308895bbaaa 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-19 05:21:40,036 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase_shell_quota_tests_table' 2023-07-19 05:21:40,349 INFO [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=14 (bloomFilter=true), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/.tmp/x/77186f7405ab442fb35c72bf1604252e 2023-07-19 05:21:40,397 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/.tmp/x/77186f7405ab442fb35c72bf1604252e as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/77186f7405ab442fb35c72bf1604252e 2023-07-19 05:21:40,406 INFO [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/77186f7405ab442fb35c72bf1604252e, entries=10, sequenceid=14, filesize=5.0 K 2023-07-19 05:21:40,410 INFO [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for eb949a69bbc58b8d725f0308895bbaaa in 553ms, sequenceid=14, compaction requested=false 2023-07-19 05:21:40,411 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eb949a69bbc58b8d725f0308895bbaaa: 2023-07-19 05:21:40,412 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-19 05:21:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-19 05:21:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-19 05:21:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689744086127' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-19 05:21:40,418 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,418 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-19 05:21:40,418 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:40,418 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 05:21:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:40,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41069,1689744086127' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-19 05:21:40,423 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-19 05:21:40,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f8a57da[Count = 0] remaining members to acquire global barrier 2023-07-19 05:21:40,423 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:40,425 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:40,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:40,425 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-19 05:21:40,425 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-19 05:21:40,425 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,425 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 05:21:40,425 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,41069,1689744086127' in zk 2023-07-19 05:21:40,427 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-19 05:21:40,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:40,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-19 05:21:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 05:21:40,428 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-19 05:21:40,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,41069,1689744086127': 2023-07-19 05:21:40,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41069,1689744086127' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-19 05:21:40,432 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-19 05:21:40,432 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 05:21:40,432 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 05:21:40,432 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-19 05:21:40,432 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-19 05:21:40,434 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:40,434 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:40,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-19 05:21:40,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:40,434 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-19 05:21:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:40,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-19 05:21:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 05:21:40,435 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,437 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,446 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,446 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-19 05:21:40,446 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:40,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-19 05:21:40,446 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:40,446 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 05:21:40,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-19 05:21:40,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-19 05:21:40,446 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-19 05:21:40,446 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 05:21:40,447 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:40,447 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:40,447 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:40,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-19 05:21:40,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 05:21:40,449 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-19 05:21:40,449 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-19 05:21:40,700 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-19 05:21:40,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.9114 seconds 2023-07-19 05:21:40,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-19 05:21:40,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689744100723 (current time:1689744100723). 2023-07-19 05:21:40,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 05:21:40,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ReadOnlyZKClient(139): Connect 0x785a982d to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:40,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e98c32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:40,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:40,733 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:40,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x785a982d to 127.0.0.1:52345 2023-07-19 05:21:40,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:40,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ReadOnlyZKClient(139): Connect 0x11e9ec76 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:40,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42dbd97d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:40,744 DEBUG [hconnection-0x7140e7bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:40,745 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:40,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11e9ec76 to 127.0.0.1:52345 2023-07-19 05:21:40,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:40,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-19 05:21:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 05:21:40,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-19 05:21:40,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-19 05:21:40,808 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-19 05:21:40,809 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=21, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1689744700809 2023-07-19 05:21:40,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-19 05:21:40,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-19 05:21:40,811 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=21, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-19 05:21:40,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-19 05:21:40,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 15 msec 2023-07-19 05:21:40,813 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-19 05:21:40,814 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1689744700814 2023-07-19 05:21:40,816 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-19 05:21:40,816 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-19 05:21:41,067 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 05:21:41,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-19 05:21:41,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-19 05:21:41,073 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 05:21:41,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,230 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_1' 2023-07-19 05:21:41,231 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 05:21:41,231 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_1' starting 'acquire' 2023-07-19 05:21:41,231 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_1', kicking off acquire phase on members. 2023-07-19 05:21:41,231 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,231 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,233 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 05:21:41,233 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 05:21:41,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 05:21:41,233 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,233 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 05:21:41,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-19 05:21:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,235 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_1 from table hbase_shell_quota_tests_table type FLUSH 2023-07-19 05:21:41,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,237 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_1' with timeout 300000ms 2023-07-19 05:21:41,237 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 05:21:41,238 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_1' starting 'acquire' stage 2023-07-19 05:21:41,238 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_1' locally acquired 2023-07-19 05:21:41,238 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689744086127' joining acquired barrier for procedure (hbase_shell_quota_tests_table_1) in zk 2023-07-19 05:21:41,240 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,240 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 05:21:41,240 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,240 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 05:21:41,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:41,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:41,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:41,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41069,1689744086127' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_1' on coordinator 2023-07-19 05:21:41,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ed8ecdf[Count = 0] remaining members to acquire global barrier 2023-07-19 05:21:41,242 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_1' starting 'in-barrier' execution. 2023-07-19 05:21:41,242 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,244 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,244 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_1' received 'reached' from coordinator. 2023-07-19 05:21:41,244 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,244 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 05:21:41,245 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 05:21:41,245 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 05:21:41,245 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:41,246 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. started... 2023-07-19 05:21:41,246 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb949a69bbc58b8d725f0308895bbaaa: 2023-07-19 05:21:41,247 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.' region-info for snapshot=hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,252 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 05:21:41,256 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/77186f7405ab442fb35c72bf1604252e] hfiles 2023-07-19 05:21:41,256 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/77186f7405ab442fb35c72bf1604252e for snapshot=hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,259 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 05:21:41,573 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 05:21:41,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-19 05:21:41,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-19 05:21:41,575 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-19 05:21:41,671 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. completed. 2023-07-19 05:21:41,671 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 05:21:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 05:21:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_1' locally completed 2023-07-19 05:21:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_1' completed for member 'jenkins-hbase4.apache.org,41069,1689744086127' in zk 2023-07-19 05:21:41,677 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_1' has notified controller of completion 2023-07-19 05:21:41,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 05:21:41,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_1' completed. 2023-07-19 05:21:41,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 05:21:41,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_1' member 'jenkins-hbase4.apache.org,41069,1689744086127': 2023-07-19 05:21:41,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41069,1689744086127' released barrier for procedure'hbase_shell_quota_tests_table_1', counting down latch. Waiting for 0 more 2023-07-19 05:21:41,682 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_1' execution completed 2023-07-19 05:21:41,682 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 05:21:41,682 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 05:21:41,682 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,682 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 05:21:41,685 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,685 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 05:21:41,685 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 05:21:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:41,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 05:21:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 05:21:41,686 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,688 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,692 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,692 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,692 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 05:21:41,692 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 05:21:41,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,692 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:41,692 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 05:21:41,692 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 05:21:41,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,692 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 05:21:41,693 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,693 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-19 05:21:41,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 05:21:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 05:21:41,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-19 05:21:42,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 to hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/hbase_shell_quota_tests_table_1 2023-07-19 05:21:42,326 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 05:21:42,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-19 05:21:42,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-19 05:21:42,328 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2428): (#4) Sleeping: 1250ms while waiting for snapshot completion. 2023-07-19 05:21:42,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed 2023-07-19 05:21:42,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-19 05:21:42,979 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-19 05:21:42,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1689744100809Consolidate snapshot: hbase_shell_quota_tests_table_1 at 1689744101692 (+883 ms)Loading Region manifests for hbase_shell_quota_tests_table_1 at 1689744101693 (+1 ms)Writing data manifest for hbase_shell_quota_tests_table_1 at 1689744101706 (+13 ms)Verifying snapshot: hbase_shell_quota_tests_table_1 at 1689744102123 (+417 ms)Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed at 1689744102978 (+855 ms) 2023-07-19 05:21:42,980 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-19 05:21:42,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 2.1690 sec 2023-07-19 05:21:43,579 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 05:21:43,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-19 05:21:43,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 2.8704 seconds Took 0.0032 seconds Took 0.0034 seconds Took 0.0025 seconds Took 0.0024 seconds Took 0.0060 seconds Took 0.0038 seconds Took 0.0025 seconds Took 0.0022 seconds Took 0.0020 seconds Took 0.0021 seconds 2023-07-19 05:21:43,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-19 05:21:43,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] procedure.ProcedureCoordinator(143): Procedure hbase_shell_quota_tests_table was in running list but was completed. Accepting new attempt. 2023-07-19 05:21:43,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-19 05:21:43,638 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-19 05:21:43,638 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-19 05:21:43,639 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-19 05:21:43,639 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-19 05:21:43,639 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:43,639 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:43,641 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:43,641 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-19 05:21:43,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-19 05:21:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 05:21:43,641 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:43,641 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 05:21:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:43,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-19 05:21:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:43,642 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-19 05:21:43,643 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc hbase_shell_quota_tests_table is still present, removing 2023-07-19 05:21:43,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-19 05:21:43,643 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-19 05:21:43,643 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-19 05:21:43,643 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-19 05:21:43,643 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-19 05:21:43,644 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-19 05:21:43,644 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:43,644 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. started... 2023-07-19 05:21:43,644 INFO [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eb949a69bbc58b8d725f0308895bbaaa 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-19 05:21:43,976 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-19 05:21:44,058 INFO [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=28 (bloomFilter=true), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/.tmp/x/d54a8c6f98f84104b1adba01719db65a 2023-07-19 05:21:44,067 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/.tmp/x/d54a8c6f98f84104b1adba01719db65a as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/d54a8c6f98f84104b1adba01719db65a 2023-07-19 05:21:44,075 INFO [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/d54a8c6f98f84104b1adba01719db65a, entries=10, sequenceid=28, filesize=5.0 K 2023-07-19 05:21:44,077 INFO [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for eb949a69bbc58b8d725f0308895bbaaa in 433ms, sequenceid=28, compaction requested=false 2023-07-19 05:21:44,077 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eb949a69bbc58b8d725f0308895bbaaa: 2023-07-19 05:21:44,077 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:44,077 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-19 05:21:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-19 05:21:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-19 05:21:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689744086127' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-19 05:21:44,084 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:44,084 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-19 05:21:44,084 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:44,084 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 05:21:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:44,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41069,1689744086127' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-19 05:21:44,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ffe5019[Count = 0] remaining members to acquire global barrier 2023-07-19 05:21:44,086 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-19 05:21:44,086 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:44,087 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:44,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:44,088 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-19 05:21:44,088 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-19 05:21:44,088 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,088 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 05:21:44,088 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,41069,1689744086127' in zk 2023-07-19 05:21:44,089 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,089 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-19 05:21:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-19 05:21:44,089 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 05:21:44,090 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-19 05:21:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:44,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,41069,1689744086127': 2023-07-19 05:21:44,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41069,1689744086127' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-19 05:21:44,093 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-19 05:21:44,094 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 05:21:44,094 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 05:21:44,094 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-19 05:21:44,094 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-19 05:21:44,095 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:44,095 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-19 05:21:44,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:44,095 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-19 05:21:44,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-19 05:21:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 05:21:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:44,096 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:44,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:44,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:44,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:44,098 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:44,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-19 05:21:44,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,101 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,101 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-19 05:21:44,101 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:44,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-19 05:21:44,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-19 05:21:44,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-19 05:21:44,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table because node does not exist (not an error) 2023-07-19 05:21:44,101 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 05:21:44,101 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-19 05:21:44,101 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-19 05:21:44,102 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 05:21:44,102 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-19 05:21:44,103 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-19 05:21:44,102 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:44,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-19 05:21:44,103 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-19 05:21:44,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 05:21:44,103 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-19 05:21:44,353 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-19 05:21:44,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.7271 seconds 2023-07-19 05:21:44,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-19 05:21:44,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689744104358 (current time:1689744104358). 2023-07-19 05:21:44,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 05:21:44,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ReadOnlyZKClient(139): Connect 0x6e73b478 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:44,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f35a890, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:44,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:44,367 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:44,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e73b478 to 127.0.0.1:52345 2023-07-19 05:21:44,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:44,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ReadOnlyZKClient(139): Connect 0x73da2919 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:21:44,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79836e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:21:44,475 DEBUG [hconnection-0x727adad9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:21:44,476 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:21:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73da2919 to 127.0.0.1:52345 2023-07-19 05:21:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:21:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-19 05:21:44,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 05:21:44,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-19 05:21:44,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-19 05:21:44,491 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-19 05:21:44,492 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=23, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1689744704492 2023-07-19 05:21:44,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-19 05:21:44,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-19 05:21:44,494 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-19 05:21:44,494 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-19 05:21:44,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-19 05:21:44,495 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=23, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-19 05:21:44,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 6 msec 2023-07-19 05:21:44,498 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-19 05:21:44,499 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=24, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1689744704499 2023-07-19 05:21:44,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,523 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_2' 2023-07-19 05:21:44,523 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 05:21:44,523 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_2' starting 'acquire' 2023-07-19 05:21:44,524 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_2', kicking off acquire phase on members. 2023-07-19 05:21:44,592 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,592 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,594 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 05:21:44,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 05:21:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 05:21:44,594 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-19 05:21:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,596 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_2 from table hbase_shell_quota_tests_table type FLUSH 2023-07-19 05:21:44,597 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,597 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 05:21:44,597 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_2' with timeout 300000ms 2023-07-19 05:21:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 05:21:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_2' starting 'acquire' stage 2023-07-19 05:21:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_2' locally acquired 2023-07-19 05:21:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41069,1689744086127' joining acquired barrier for procedure (hbase_shell_quota_tests_table_2) in zk 2023-07-19 05:21:44,600 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,600 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 05:21:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:44,600 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,600 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 05:21:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:44,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41069,1689744086127' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_2' on coordinator 2023-07-19 05:21:44,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e7dd089[Count = 0] remaining members to acquire global barrier 2023-07-19 05:21:44,603 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_2' starting 'in-barrier' execution. 2023-07-19 05:21:44,603 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,604 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,604 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_2' received 'reached' from coordinator. 2023-07-19 05:21:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 05:21:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 05:21:44,605 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:44,605 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. started... 2023-07-19 05:21:44,605 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:44,606 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 05:21:44,606 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb949a69bbc58b8d725f0308895bbaaa: 2023-07-19 05:21:44,606 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa.' region-info for snapshot=hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,606 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 05:21:44,606 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/77186f7405ab442fb35c72bf1604252e, hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/d54a8c6f98f84104b1adba01719db65a] hfiles 2023-07-19 05:21:44,606 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/77186f7405ab442fb35c72bf1604252e for snapshot=hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,606 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/x/d54a8c6f98f84104b1adba01719db65a for snapshot=hbase_shell_quota_tests_table_2 2023-07-19 05:21:44,607 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 05:21:44,745 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 05:21:44,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-19 05:21:44,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-19 05:21:44,749 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 05:21:45,052 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. completed. 2023-07-19 05:21:45,052 DEBUG [rs(jenkins-hbase4.apache.org,41069,1689744086127)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:21:45,052 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 05:21:45,052 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 05:21:45,053 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,053 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_2' locally completed 2023-07-19 05:21:45,053 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_2' completed for member 'jenkins-hbase4.apache.org,41069,1689744086127' in zk 2023-07-19 05:21:45,056 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,056 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_2' has notified controller of completion 2023-07-19 05:21:45,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:45,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 05:21:45,056 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 05:21:45,056 DEBUG [member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_2' completed. 2023-07-19 05:21:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_2' member 'jenkins-hbase4.apache.org,41069,1689744086127': 2023-07-19 05:21:45,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41069,1689744086127' released barrier for procedure'hbase_shell_quota_tests_table_2', counting down latch. Waiting for 0 more 2023-07-19 05:21:45,062 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_2' execution completed 2023-07-19 05:21:45,062 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 05:21:45,062 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 05:21:45,062 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,062 INFO [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_2including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 05:21:45,064 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,064 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 05:21:45,064 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 05:21:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 05:21:45,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 05:21:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 05:21:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 05:21:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,066 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 05:21:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,072 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 05:21:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,076 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 05:21:45,076 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 05:21:45,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 05:21:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 05:21:45,077 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,077 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,077 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,077 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:21:45,077 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,077 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,077 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,077 DEBUG [(jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 05:21:45,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 05:21:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 05:21:45,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 because node does not exist (not an error) 2023-07-19 05:21:45,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,250 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 05:21:45,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-19 05:21:45,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-19 05:21:45,252 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-19 05:21:45,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 to hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed 2023-07-19 05:21:45,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,565 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-19 05:21:45,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1689744104493Consolidate snapshot: hbase_shell_quota_tests_table_2 at 1689744105078 (+585 ms)Loading Region manifests for hbase_shell_quota_tests_table_2 at 1689744105078Writing data manifest for hbase_shell_quota_tests_table_2 at 1689744105085 (+7 ms)Verifying snapshot: hbase_shell_quota_tests_table_2 at 1689744105505 (+420 ms)Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed at 1689744105564 (+59 ms) 2023-07-19 05:21:45,567 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=24, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-19 05:21:45,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 1.0740 sec 2023-07-19 05:21:46,003 DEBUG [Listener at localhost/46177] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 05:21:46,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-19 05:21:46,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 1.6501 seconds 2023-07-19 05:23:46,579 DEBUG [master/jenkins-hbase4:0.Chore.1] quotas.QuotaObserverChore(336): hbase_shell_quota_tests_table moved into observance of table space quota. 2023-07-19 05:26:26,144 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache(965): totalSize=587.81 KB, freeSize=781.83 MB, max=782.40 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2023-07-19 05:26:26,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): data stats (chunk size=2097152): current pool size=1, created chunk count=9, reused chunk count=1, reuseRatio=10.00% 2023-07-19 05:26:26,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2023-07-19 05:26:28,103 INFO [jenkins-hbase4:41069Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-19 05:26:29,442 DEBUG [master/jenkins-hbase4:0.Chore.1] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster. 2023-07-19 05:26:29,443 DEBUG [master/jenkins-hbase4:0.Chore.1] master.HMaster(1882): Balancer is going into sleep until next period in 300000ms 2023-07-19 05:26:29,449 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(200): Skipping table hbase_shell_quota_tests_table because normalization is disabled in its table properties and normalization is also disabled at table level by default 2023-07-19 05:26:29,455 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 05:26:31,100 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because 1588230740/info has an old edit so flush to free WALs after random delay 265511 ms 2023-07-19 05:26:31,101 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. because 7423337174813689edb9c40059b88fb0/info has an old edit so flush to free WALs after random delay 147426 ms 2023-07-19 05:26:32,076 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. because 336bb3bcc81b85a0e86f21bf4a9879bd/l has an old edit so flush to free WALs after random delay 296499 ms 2023-07-19 05:26:34,157 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. because bb042bb445aa4cb737b5c2b4232e6066/f has an old edit so flush to free WALs after random delay 6324 ms 2023-07-19 05:26:34,723 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-19 05:26:39,096 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. because 9f4af27c17981ba6f64c8eb72cdea6f4/q has an old edit so flush to free WALs after random delay 105958 ms 2023-07-19 05:26:39,779 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:26:39,781 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2023-07-19 05:26:40,482 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing bb042bb445aa4cb737b5c2b4232e6066 1/1 column families, dataSize=32 B heapSize=360 B 2023-07-19 05:26:40,499 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32 B at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066/.tmp/f/6f0cb7c15d754687a8a2bdcb8ca8bb17 2023-07-19 05:26:40,508 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066/.tmp/f/6f0cb7c15d754687a8a2bdcb8ca8bb17 as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066/f/6f0cb7c15d754687a8a2bdcb8ca8bb17 2023-07-19 05:26:40,515 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066/f/6f0cb7c15d754687a8a2bdcb8ca8bb17, entries=1, sequenceid=4, filesize=4.6 K 2023-07-19 05:26:40,516 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~32 B/32, heapSize ~344 B/344, currentSize=0 B/0 for bb042bb445aa4cb737b5c2b4232e6066 in 34ms, sequenceid=4, compaction requested=false 2023-07-19 05:26:40,516 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for bb042bb445aa4cb737b5c2b4232e6066: 2023-07-19 05:27:31,083 DEBUG [master/jenkins-hbase4:0.Chore.1] zookeeper.ReadOnlyZKClient(139): Connect 0x4aff5a82 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,087 DEBUG [master/jenkins-hbase4:0.Chore.1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12701621, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,089 DEBUG [hconnection-0xe3e3d12-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,090 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:27:31,352 INFO [Listener at localhost/46177] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:27:31,352 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41e7c3e5 to 127.0.0.1:52345 2023-07-19 05:27:31,352 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,356 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x4d5ec687 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,365 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69ee0846, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,368 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,369 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:27:31,375 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d5ec687 to 127.0.0.1:52345 2023-07-19 05:27:31,375 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,380 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x0a155c03 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,384 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@440fe5cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,386 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,388 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:27:31,393 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a155c03 to 127.0.0.1:52345 2023-07-19 05:27:31,393 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,394 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x5446617d to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,398 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78cc402f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,401 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,402 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:27:31,406 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5446617d to 127.0.0.1:52345 2023-07-19 05:27:31,406 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,408 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x560ff9b1 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,411 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dbaf306, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,413 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,415 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0116 seconds Took 0.0014 seconds Took 0.0013 seconds Took 0.0015 seconds Took 0.0013 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0007 seconds Took 0.0008 seconds Took 0.0007 seconds Took 0.0007 seconds Took 0.0008 seconds 2023-07-19 05:27:31,462 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x560ff9b1 to 127.0.0.1:52345 2023-07-19 05:27:31,462 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,464 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x357e4dc1 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,469 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f9f6026, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,471 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,473 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0012 seconds 2023-07-19 05:27:31,481 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x357e4dc1 to 127.0.0.1:52345 2023-07-19 05:27:31,481 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,482 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x233f6616 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,486 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@95ec921, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,488 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,489 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0008 seconds 2023-07-19 05:27:31,494 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x233f6616 to 127.0.0.1:52345 2023-07-19 05:27:31,495 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,498 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x22577d11 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,502 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2682bbe5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,503 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,505 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0009 seconds 2023-07-19 05:27:31,509 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22577d11 to 127.0.0.1:52345 2023-07-19 05:27:31,510 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,511 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x4ad38970 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,515 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6862f294, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,517 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,518 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:27:31,521 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:27:31,523 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0056 seconds 2023-07-19 05:27:31,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from false to true 2023-07-19 05:27:31,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from true to false Took 0.0031 seconds 2023-07-19 05:27:31,544 INFO [Listener at localhost/46177] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:27:31,545 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ad38970 to 127.0.0.1:52345 2023-07-19 05:27:31,545 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,546 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x6f80b667 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,551 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20a98da1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,553 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,555 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 05:27:31,559 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 05:27:31,561 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 05:27:31,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] zookeeper.ZKUtil(398): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-19 05:27:31,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from true to false 2023-07-19 05:27:31,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] procedure2.ProcedureExecutor(1029): Stored pid=25, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,40633,1689744084421, rpcThrottleEnabled=false 2023-07-19 05:27:31,576 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:27:31,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,41069,1689744086127, rpcThrottleEnabled=false}] 2023-07-19 05:27:31,737 DEBUG [RSProcedureDispatcher-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 05:27:31,739 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 05:27:31,740 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41069] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=26 2023-07-19 05:27:31,741 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from true to false 2023-07-19 05:27:31,744 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=26 2023-07-19 05:27:31,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40633] master.HMaster(3641): Remote procedure done, pid=26 2023-07-19 05:27:31,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=25 2023-07-19 05:27:31,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=25, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,41069,1689744086127, rpcThrottleEnabled=false in 170 msec 2023-07-19 05:27:31,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,40633,1689744084421, rpcThrottleEnabled=false in 184 msec 2023-07-19 05:27:31,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from false to true 2023-07-19 05:27:31,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40633] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,40633,1689744084421, rpcThrottleEnabled=true 2023-07-19 05:27:31,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,41069,1689744086127, rpcThrottleEnabled=true}] 2023-07-19 05:27:31,910 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41069] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=28 2023-07-19 05:27:31,911 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from false to true 2023-07-19 05:27:31,911 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=28 2023-07-19 05:27:31,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40633] master.HMaster(3641): Remote procedure done, pid=28 2023-07-19 05:27:31,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-19 05:27:31,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,41069,1689744086127, rpcThrottleEnabled=true in 155 msec 2023-07-19 05:27:31,917 INFO [Listener at localhost/46177] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:27:31,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,40633,1689744084421, rpcThrottleEnabled=true in 162 msec 2023-07-19 05:27:31,917 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f80b667 to 127.0.0.1:52345 2023-07-19 05:27:31,918 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-19 05:27:31,920 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(139): Connect 0x0f9088c2 to 127.0.0.1:52345 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 05:27:31,924 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4364d6ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-19 05:27:31,927 DEBUG [Listener at localhost/46177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 05:27:31,928 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0010 seconds 2023-07-19 05:27:31,933 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f9088c2 to 127.0.0.1:52345 2023-07-19 05:27:31,933 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client . Finished in 354.77487499999995 seconds. ------------------------------------------------------------------------------- 16 tests, 62 assertions, 0 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications 100% passed ------------------------------------------------------------------------------- 0.05 tests/s, 0.17 assertions/s Done with tests! Shutting down the cluster... 2023-07-19 05:27:31,956 INFO [Listener at localhost/46177] hbase.ResourceChecker(175): after: client.TestQuotasShell#testRunShellTests Thread=268 (was 239) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x6f80b667-SendThread(127.0.0.1:52345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x671f8795-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x22577d11 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1844950326.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe3e3d12-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x22577d11-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: (jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x22577d11-SendThread(127.0.0.1:52345) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x6f80b667 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1844950326.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x4aff5a82 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1844950326.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x671f8795-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x357e4dc1 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1844950326.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x6f80b667-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40633,1689744084421)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x0f9088c2-SendThread(127.0.0.1:52345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x357e4dc1-SendThread(127.0.0.1:52345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1702683620_17 at /127.0.0.1:33378 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x4aff5a82-SendThread(127.0.0.1:52345) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Ruby-0-JIT-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x671f8795-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x0f9088c2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x233f6616-SendThread(127.0.0.1:52345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x357e4dc1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x4aff5a82-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x671f8795-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x0f9088c2 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1844950326.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jnr.ffi.util.ref.internal.Finalizer java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) jnr.ffi.util.ref.internal.Finalizer.run(Finalizer.java:180) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x233f6616 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1844950326.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe3e3d12-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41069,1689744086127' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52345@0x233f6616-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=493 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=32 (was 136), ProcessCount=168 (was 173), AvailableMemoryMB=5547 (was 5492) - AvailableMemoryMB LEAK? - 2023-07-19 05:27:31,957 INFO [Listener at localhost/46177] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 05:27:31,957 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d1815e1 to 127.0.0.1:52345 2023-07-19 05:27:31,957 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:27:31,958 DEBUG [Listener at localhost/46177] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 05:27:31,958 DEBUG [Listener at localhost/46177] util.JVMClusterUtil(257): Found active master hash=1049816814, stopped=false 2023-07-19 05:27:31,958 DEBUG [Listener at localhost/46177] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:27:31,958 DEBUG [Listener at localhost/46177] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 05:27:31,958 DEBUG [Listener at localhost/46177] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:27:31,958 DEBUG [Listener at localhost/46177] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-19 05:27:31,958 INFO [Listener at localhost/46177] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:27:31,960 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 05:27:31,960 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 05:27:31,960 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:27:31,960 INFO [Listener at localhost/46177] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 05:27:31,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 05:27:31,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 05:27:31,961 DEBUG [Listener at localhost/46177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x784dbb9e to 127.0.0.1:52345 2023-07-19 05:27:31,961 DEBUG [Listener at localhost/46177] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:27:31,961 INFO [Listener at localhost/46177] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41069,1689744086127' ***** 2023-07-19 05:27:31,961 DEBUG [Listener at localhost/46177] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:27:31,962 INFO [Listener at localhost/46177] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 05:27:31,962 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-19 05:27:31,970 INFO [RS:0;jenkins-hbase4:41069] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@3106071a{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-19 05:27:31,974 INFO [RS:0;jenkins-hbase4:41069] server.AbstractConnector(383): Stopped ServerConnector@4401030e{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-19 05:27:31,974 INFO [RS:0;jenkins-hbase4:41069] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-19 05:27:31,975 INFO [RS:0;jenkins-hbase4:41069] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@542f414e{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-19 05:27:31,975 INFO [RS:0;jenkins-hbase4:41069] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@27a05f4c{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/hadoop.log.dir/,STOPPED} 2023-07-19 05:27:31,977 INFO [RS:0;jenkins-hbase4:41069] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 05:27:31,977 INFO [RS:0;jenkins-hbase4:41069] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 05:27:31,977 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 05:27:31,977 INFO [RS:0;jenkins-hbase4:41069] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 05:27:31,978 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(3305): Received CLOSE for eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:27:31,978 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(3305): Received CLOSE for 336bb3bcc81b85a0e86f21bf4a9879bd 2023-07-19 05:27:31,978 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(3305): Received CLOSE for 7423337174813689edb9c40059b88fb0 2023-07-19 05:27:31,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eb949a69bbc58b8d725f0308895bbaaa, disabling compactions & flushes 2023-07-19 05:27:31,978 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(3305): Received CLOSE for bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:27:31,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:27:31,979 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(3305): Received CLOSE for 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:27:31,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:27:31,979 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:27:31,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. after waiting 0 ms 2023-07-19 05:27:31,979 INFO [RS:0;jenkins-hbase4:41069] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 05:27:31,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:27:31,979 DEBUG [RS:0;jenkins-hbase4:41069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f7ae260 to 127.0.0.1:52345 2023-07-19 05:27:31,979 DEBUG [RS:0;jenkins-hbase4:41069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:27:31,979 INFO [RS:0;jenkins-hbase4:41069] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 05:27:31,979 INFO [RS:0;jenkins-hbase4:41069] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 05:27:31,979 INFO [RS:0;jenkins-hbase4:41069] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 05:27:31,979 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 05:27:31,979 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1474): Waiting on 6 regions to close 2023-07-19 05:27:31,979 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1478): Online Regions={eb949a69bbc58b8d725f0308895bbaaa=hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa., 336bb3bcc81b85a0e86f21bf4a9879bd=hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd., 1588230740=hbase:meta,,1.1588230740, 7423337174813689edb9c40059b88fb0=hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0., bb042bb445aa4cb737b5c2b4232e6066=hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066., 9f4af27c17981ba6f64c8eb72cdea6f4=hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4.} 2023-07-19 05:27:31,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 05:27:31,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 05:27:31,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 05:27:31,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 05:27:31,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 05:27:31,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=6.34 KB heapSize=11.52 KB 2023-07-19 05:27:31,982 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1504): Waiting on 1588230740, 336bb3bcc81b85a0e86f21bf4a9879bd, 7423337174813689edb9c40059b88fb0, 9f4af27c17981ba6f64c8eb72cdea6f4, bb042bb445aa4cb737b5c2b4232e6066, eb949a69bbc58b8d725f0308895bbaaa 2023-07-19 05:27:31,986 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 05:27:31,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/default/hbase_shell_quota_tests_table/eb949a69bbc58b8d725f0308895bbaaa/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-19 05:27:31,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:27:31,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:27:31,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:27:31,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eb949a69bbc58b8d725f0308895bbaaa: 2023-07-19 05:27:31,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase_shell_quota_tests_table,,1689744097266.eb949a69bbc58b8d725f0308895bbaaa. 2023-07-19 05:27:31,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 336bb3bcc81b85a0e86f21bf4a9879bd, disabling compactions & flushes 2023-07-19 05:27:31,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:27:31,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:27:31,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. after waiting 0 ms 2023-07-19 05:27:31,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:27:31,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 336bb3bcc81b85a0e86f21bf4a9879bd 1/1 column families, dataSize=163 B heapSize=648 B 2023-07-19 05:27:32,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.88 KB at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/.tmp/info/1dff3553ccbf4ca7aeb9b6ce7b330b8a 2023-07-19 05:27:32,074 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-19 05:27:32,075 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-19 05:27:32,183 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1504): Waiting on 1588230740, 336bb3bcc81b85a0e86f21bf4a9879bd, 7423337174813689edb9c40059b88fb0, 9f4af27c17981ba6f64c8eb72cdea6f4, bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:27:32,383 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1504): Waiting on 1588230740, 336bb3bcc81b85a0e86f21bf4a9879bd, 7423337174813689edb9c40059b88fb0, 9f4af27c17981ba6f64c8eb72cdea6f4, bb042bb445aa4cb737b5c2b4232e6066 2023-07-19 05:27:32,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=163 B at sequenceid=7 (bloomFilter=false), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd/.tmp/l/b45fc003aef34c43b1097281d4010554 2023-07-19 05:27:32,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd/.tmp/l/b45fc003aef34c43b1097281d4010554 as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd/l/b45fc003aef34c43b1097281d4010554 2023-07-19 05:27:32,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=472 B at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/.tmp/table/1233ffa03ec74c7b8d7e434f9001742f 2023-07-19 05:27:32,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd/l/b45fc003aef34c43b1097281d4010554, entries=3, sequenceid=7, filesize=4.7 K 2023-07-19 05:27:32,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~163 B/163, heapSize ~632 B/632, currentSize=0 B/0 for 336bb3bcc81b85a0e86f21bf4a9879bd in 437ms, sequenceid=7, compaction requested=false 2023-07-19 05:27:32,431 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/.tmp/info/1dff3553ccbf4ca7aeb9b6ce7b330b8a as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/info/1dff3553ccbf4ca7aeb9b6ce7b330b8a 2023-07-19 05:27:32,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/acl/336bb3bcc81b85a0e86f21bf4a9879bd/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-07-19 05:27:32,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:27:32,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:27:32,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:27:32,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 336bb3bcc81b85a0e86f21bf4a9879bd: 2023-07-19 05:27:32,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689744091007.336bb3bcc81b85a0e86f21bf4a9879bd. 2023-07-19 05:27:32,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7423337174813689edb9c40059b88fb0, disabling compactions & flushes 2023-07-19 05:27:32,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:27:32,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:27:32,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. after waiting 0 ms 2023-07-19 05:27:32,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:27:32,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7423337174813689edb9c40059b88fb0 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 05:27:32,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/info/1dff3553ccbf4ca7aeb9b6ce7b330b8a, entries=50, sequenceid=29, filesize=10.6 K 2023-07-19 05:27:32,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/.tmp/table/1233ffa03ec74c7b8d7e434f9001742f as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/table/1233ffa03ec74c7b8d7e434f9001742f 2023-07-19 05:27:32,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/table/1233ffa03ec74c7b8d7e434f9001742f, entries=10, sequenceid=29, filesize=5.1 K 2023-07-19 05:27:32,448 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~6.34 KB/6489, heapSize ~11.23 KB/11504, currentSize=0 B/0 for 1588230740 in 468ms, sequenceid=29, compaction requested=false 2023-07-19 05:27:32,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/meta/1588230740/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-19 05:27:32,458 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:27:32,458 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 05:27:32,458 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:27:32,458 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 05:27:32,458 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 05:27:32,459 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 05:27:32,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0/.tmp/info/7707994241ab457589efaadb7b347822 2023-07-19 05:27:32,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0/.tmp/info/7707994241ab457589efaadb7b347822 as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0/info/7707994241ab457589efaadb7b347822 2023-07-19 05:27:32,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0/info/7707994241ab457589efaadb7b347822, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 05:27:32,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7423337174813689edb9c40059b88fb0 in 39ms, sequenceid=6, compaction requested=false 2023-07-19 05:27:32,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/namespace/7423337174813689edb9c40059b88fb0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 05:27:32,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:27:32,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:27:32,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:27:32,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7423337174813689edb9c40059b88fb0: 2023-07-19 05:27:32,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689744089456.7423337174813689edb9c40059b88fb0. 2023-07-19 05:27:32,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb042bb445aa4cb737b5c2b4232e6066, disabling compactions & flushes 2023-07-19 05:27:32,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:27:32,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:27:32,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. after waiting 0 ms 2023-07-19 05:27:32,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:27:32,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/labels/bb042bb445aa4cb737b5c2b4232e6066/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=1 2023-07-19 05:27:32,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:27:32,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:27:32,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:27:32,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb042bb445aa4cb737b5c2b4232e6066: 2023-07-19 05:27:32,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:labels,,1689744091927.bb042bb445aa4cb737b5c2b4232e6066. 2023-07-19 05:27:32,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f4af27c17981ba6f64c8eb72cdea6f4, disabling compactions & flushes 2023-07-19 05:27:32,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:27:32,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:27:32,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. after waiting 0 ms 2023-07-19 05:27:32,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:27:32,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9f4af27c17981ba6f64c8eb72cdea6f4 2/2 column families, dataSize=1.31 KB heapSize=3.84 KB 2023-07-19 05:27:32,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=830 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/.tmp/q/e2e93f4153f04d7f9716c44fedfd178c 2023-07-19 05:27:32,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2e93f4153f04d7f9716c44fedfd178c 2023-07-19 05:27:32,583 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1504): Waiting on 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:27:32,783 DEBUG [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1504): Waiting on 9f4af27c17981ba6f64c8eb72cdea6f4 2023-07-19 05:27:32,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=510 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/.tmp/u/ff166d6912184866802b0ed931405817 2023-07-19 05:27:32,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff166d6912184866802b0ed931405817 2023-07-19 05:27:32,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/.tmp/q/e2e93f4153f04d7f9716c44fedfd178c as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/q/e2e93f4153f04d7f9716c44fedfd178c 2023-07-19 05:27:32,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2e93f4153f04d7f9716c44fedfd178c 2023-07-19 05:27:32,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/q/e2e93f4153f04d7f9716c44fedfd178c, entries=8, sequenceid=24, filesize=5.2 K 2023-07-19 05:27:32,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/.tmp/u/ff166d6912184866802b0ed931405817 as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/u/ff166d6912184866802b0ed931405817 2023-07-19 05:27:32,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff166d6912184866802b0ed931405817 2023-07-19 05:27:32,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/u/ff166d6912184866802b0ed931405817, entries=10, sequenceid=24, filesize=5.4 K 2023-07-19 05:27:32,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.31 KB/1340, heapSize ~3.80 KB/3896, currentSize=0 B/0 for 9f4af27c17981ba6f64c8eb72cdea6f4 in 448ms, sequenceid=24, compaction requested=false 2023-07-19 05:27:32,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/data/hbase/quota/9f4af27c17981ba6f64c8eb72cdea6f4/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-19 05:27:32,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 05:27:32,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-19 05:27:32,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:27:32,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f4af27c17981ba6f64c8eb72cdea6f4: 2023-07-19 05:27:32,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1689744090969.9f4af27c17981ba6f64c8eb72cdea6f4. 2023-07-19 05:27:32,984 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41069,1689744086127; all regions closed. 2023-07-19 05:27:32,984 DEBUG [RS:0;jenkins-hbase4:41069] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-19 05:27:32,995 DEBUG [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/oldWALs 2023-07-19 05:27:32,995 INFO [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41069%2C1689744086127.meta:.meta(num 1689744089140) 2023-07-19 05:27:32,999 DEBUG [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/oldWALs 2023-07-19 05:27:32,999 INFO [RS:0;jenkins-hbase4:41069] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41069%2C1689744086127:(num 1689744088224) 2023-07-19 05:27:33,000 DEBUG [RS:0;jenkins-hbase4:41069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:27:33,000 INFO [RS:0;jenkins-hbase4:41069] regionserver.LeaseManager(133): Closed leases 2023-07-19 05:27:33,000 INFO [RS:0;jenkins-hbase4:41069] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 05:27:33,000 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 05:27:33,001 INFO [RS:0;jenkins-hbase4:41069] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41069 2023-07-19 05:27:33,010 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41069,1689744086127 2023-07-19 05:27:33,010 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 05:27:33,010 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 05:27:33,012 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41069,1689744086127] 2023-07-19 05:27:33,012 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41069,1689744086127; numProcessing=1 2023-07-19 05:27:33,013 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41069,1689744086127 already deleted, retry=false 2023-07-19 05:27:33,013 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41069,1689744086127 expired; onlineServers=0 2023-07-19 05:27:33,013 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40633,1689744084421' ***** 2023-07-19 05:27:33,013 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 05:27:33,014 DEBUG [M:0;jenkins-hbase4:40633] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fafe4d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 05:27:33,014 INFO [M:0;jenkins-hbase4:40633] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-19 05:27:33,017 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 05:27:33,018 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 05:27:33,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 05:27:33,018 INFO [M:0;jenkins-hbase4:40633] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@748a1947{master,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-19 05:27:33,019 INFO [M:0;jenkins-hbase4:40633] server.AbstractConnector(383): Stopped ServerConnector@5d913362{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-19 05:27:33,019 INFO [M:0;jenkins-hbase4:40633] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-19 05:27:33,019 INFO [M:0;jenkins-hbase4:40633] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@ecbdb00{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-19 05:27:33,020 INFO [M:0;jenkins-hbase4:40633] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@39035498{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/hadoop.log.dir/,STOPPED} 2023-07-19 05:27:33,020 INFO [M:0;jenkins-hbase4:40633] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40633,1689744084421 2023-07-19 05:27:33,020 INFO [M:0;jenkins-hbase4:40633] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40633,1689744084421; all regions closed. 2023-07-19 05:27:33,020 DEBUG [M:0;jenkins-hbase4:40633] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 05:27:33,020 INFO [M:0;jenkins-hbase4:40633] master.HMaster(1491): Stopping master jetty server 2023-07-19 05:27:33,021 INFO [M:0;jenkins-hbase4:40633] server.AbstractConnector(383): Stopped ServerConnector@18cecf30{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-19 05:27:33,021 DEBUG [M:0;jenkins-hbase4:40633] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 05:27:33,021 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 05:27:33,021 DEBUG [M:0;jenkins-hbase4:40633] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 05:27:33,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689744087863] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689744087863,5,FailOnTimeoutGroup] 2023-07-19 05:27:33,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689744087862] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689744087862,5,FailOnTimeoutGroup] 2023-07-19 05:27:33,022 INFO [M:0;jenkins-hbase4:40633] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 05:27:33,022 INFO [M:0;jenkins-hbase4:40633] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 05:27:33,022 INFO [M:0;jenkins-hbase4:40633] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 05:27:33,022 DEBUG [M:0;jenkins-hbase4:40633] master.HMaster(1512): Stopping service threads 2023-07-19 05:27:33,022 INFO [M:0;jenkins-hbase4:40633] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 05:27:33,023 INFO [M:0;jenkins-hbase4:40633] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 05:27:33,023 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 05:27:33,023 DEBUG [M:0;jenkins-hbase4:40633] zookeeper.ZKUtil(398): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 05:27:33,023 WARN [M:0;jenkins-hbase4:40633] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 05:27:33,023 INFO [M:0;jenkins-hbase4:40633] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 05:27:33,024 INFO [M:0;jenkins-hbase4:40633] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 05:27:33,024 DEBUG [M:0;jenkins-hbase4:40633] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 05:27:33,024 INFO [M:0;jenkins-hbase4:40633] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 05:27:33,024 DEBUG [M:0;jenkins-hbase4:40633] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 05:27:33,024 DEBUG [M:0;jenkins-hbase4:40633] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 05:27:33,024 DEBUG [M:0;jenkins-hbase4:40633] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 05:27:33,024 INFO [M:0;jenkins-hbase4:40633] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=95.75 KB heapSize=115.68 KB 2023-07-19 05:27:33,112 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 05:27:33,112 INFO [RS:0;jenkins-hbase4:41069] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41069,1689744086127; zookeeper connection closed. 2023-07-19 05:27:33,112 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): regionserver:41069-0x1017c070d690001, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 05:27:33,113 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@19d415a2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@19d415a2 2023-07-19 05:27:33,113 INFO [Listener at localhost/46177] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-19 05:27:33,439 INFO [M:0;jenkins-hbase4:40633] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=95.75 KB at sequenceid=237 (bloomFilter=true), to=hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c13730cce8da4938b0bbdd0346f79c95 2023-07-19 05:27:33,445 INFO [M:0;jenkins-hbase4:40633] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c13730cce8da4938b0bbdd0346f79c95 2023-07-19 05:27:33,446 DEBUG [M:0;jenkins-hbase4:40633] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c13730cce8da4938b0bbdd0346f79c95 as hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c13730cce8da4938b0bbdd0346f79c95 2023-07-19 05:27:33,452 INFO [M:0;jenkins-hbase4:40633] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c13730cce8da4938b0bbdd0346f79c95 2023-07-19 05:27:33,452 INFO [M:0;jenkins-hbase4:40633] regionserver.HStore(1080): Added hdfs://localhost:37249/user/jenkins/test-data/def7fe31-1195-25bb-e3d4-7f38b6c29287/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c13730cce8da4938b0bbdd0346f79c95, entries=28, sequenceid=237, filesize=7.7 K 2023-07-19 05:27:33,453 INFO [M:0;jenkins-hbase4:40633] regionserver.HRegion(2948): Finished flush of dataSize ~95.75 KB/98050, heapSize ~115.66 KB/118440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 429ms, sequenceid=237, compaction requested=false 2023-07-19 05:27:33,455 INFO [M:0;jenkins-hbase4:40633] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 05:27:33,455 DEBUG [M:0;jenkins-hbase4:40633] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 05:27:33,458 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 05:27:33,458 INFO [M:0;jenkins-hbase4:40633] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 05:27:33,459 INFO [M:0;jenkins-hbase4:40633] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40633 2023-07-19 05:27:33,461 DEBUG [M:0;jenkins-hbase4:40633] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40633,1689744084421 already deleted, retry=false 2023-07-19 05:27:33,563 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 05:27:33,563 INFO [M:0;jenkins-hbase4:40633] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40633,1689744084421; zookeeper connection closed. 2023-07-19 05:27:33,563 DEBUG [Listener at localhost/46177-EventThread] zookeeper.ZKWatcher(600): master:40633-0x1017c070d690000, quorum=127.0.0.1:52345, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 05:27:33,565 WARN [Listener at localhost/46177] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 05:27:33,567 INFO [Listener at localhost/46177] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 05:27:33,671 WARN [BP-930228287-172.31.14.131-1689744081402 heartbeating to localhost/127.0.0.1:37249] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 05:27:33,671 WARN [BP-930228287-172.31.14.131-1689744081402 heartbeating to localhost/127.0.0.1:37249] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-930228287-172.31.14.131-1689744081402 (Datanode Uuid 76b78119-ef30-4cdc-9329-b7de5a7bc1eb) service to localhost/127.0.0.1:37249 2023-07-19 05:27:33,673 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/cluster_f94bf6a0-4d70-c64f-76a8-aa990e0b75c7/dfs/data/data1/current/BP-930228287-172.31.14.131-1689744081402] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 05:27:33,673 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/53de5f69-54e4-18db-ed5e-d7f162364efe/cluster_f94bf6a0-4d70-c64f-76a8-aa990e0b75c7/dfs/data/data2/current/BP-930228287-172.31.14.131-1689744081402] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 05:27:33,707 INFO [Listener at localhost/46177] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 05:27:33,817 INFO [Listener at localhost/46177] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 05:27:33,840 INFO [Listener at localhost/46177] hbase.HBaseTestingUtility(1293): Minicluster is down