2023-07-15 13:22:19,602 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df 2023-07-15 13:22:19,712 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestQuotasShell timeout: 13 mins 2023-07-15 13:22:19,815 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 13:22:19,916 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 13:22:19,916 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/cluster_11902d41-4ac4-9fd2-5a37-2f14ecb48e66, deleteOnExit=true 2023-07-15 13:22:19,916 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 13:22:19,917 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/test.cache.data in system properties and HBase conf 2023-07-15 13:22:19,917 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 13:22:19,917 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/hadoop.log.dir in system properties and HBase conf 2023-07-15 13:22:19,918 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 13:22:19,918 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 13:22:19,918 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 13:22:20,223 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 13:22:20,230 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 13:22:20,230 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 13:22:20,231 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 13:22:20,231 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 13:22:20,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 13:22:20,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 13:22:20,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 13:22:20,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 13:22:20,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 13:22:20,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/nfs.dump.dir in system properties and HBase conf 2023-07-15 13:22:20,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/java.io.tmpdir in system properties and HBase conf 2023-07-15 13:22:20,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 13:22:20,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 13:22:20,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 13:22:20,735 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 13:22:20,739 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 13:22:21,024 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 13:22:21,176 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 13:22:21,190 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 13:22:21,223 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 13:22:21,255 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/java.io.tmpdir/Jetty_localhost_40157_hdfs____2fnps1/webapp 2023-07-15 13:22:21,385 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40157 2023-07-15 13:22:21,404 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 13:22:21,404 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 13:22:21,897 WARN [Listener at localhost/36795] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 13:22:22,063 WARN [Listener at localhost/36795] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 13:22:22,081 WARN [Listener at localhost/36795] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 13:22:22,087 INFO [Listener at localhost/36795] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 13:22:22,092 INFO [Listener at localhost/36795] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/java.io.tmpdir/Jetty_localhost_40785_datanode____phf527/webapp 2023-07-15 13:22:22,191 INFO [Listener at localhost/36795] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40785 2023-07-15 13:22:22,430 WARN [Listener at localhost/36741] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 13:22:22,873 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69563f9a2b170b85: Processing first storage report for DS-07534f14-0eaa-480d-b089-a39219afb3ac from datanode a1b9f9bb-5cdc-4b39-adb3-e10a731c6fee 2023-07-15 13:22:22,875 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69563f9a2b170b85: from storage DS-07534f14-0eaa-480d-b089-a39219afb3ac node DatanodeRegistration(127.0.0.1:44797, datanodeUuid=a1b9f9bb-5cdc-4b39-adb3-e10a731c6fee, infoPort=38763, infoSecurePort=0, ipcPort=36741, storageInfo=lv=-57;cid=testClusterID;nsid=498873275;c=1689427340812), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 13:22:22,875 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69563f9a2b170b85: Processing first storage report for DS-e2ee5ff7-84bc-40ac-ba6d-ef65831cf726 from datanode a1b9f9bb-5cdc-4b39-adb3-e10a731c6fee 2023-07-15 13:22:22,875 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69563f9a2b170b85: from storage DS-e2ee5ff7-84bc-40ac-ba6d-ef65831cf726 node DatanodeRegistration(127.0.0.1:44797, datanodeUuid=a1b9f9bb-5cdc-4b39-adb3-e10a731c6fee, infoPort=38763, infoSecurePort=0, ipcPort=36741, storageInfo=lv=-57;cid=testClusterID;nsid=498873275;c=1689427340812), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 13:22:22,942 DEBUG [Listener at localhost/36741] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df 2023-07-15 13:22:23,023 INFO [Listener at localhost/36741] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/cluster_11902d41-4ac4-9fd2-5a37-2f14ecb48e66/zookeeper_0, clientPort=64702, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/cluster_11902d41-4ac4-9fd2-5a37-2f14ecb48e66/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/cluster_11902d41-4ac4-9fd2-5a37-2f14ecb48e66/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 13:22:23,042 INFO [Listener at localhost/36741] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64702 2023-07-15 13:22:23,050 INFO [Listener at localhost/36741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 13:22:23,053 INFO [Listener at localhost/36741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 13:22:23,726 INFO [Listener at localhost/36741] util.FSUtils(471): Created version file at hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268 with version=8 2023-07-15 13:22:23,727 INFO [Listener at localhost/36741] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/hbase-staging 2023-07-15 13:22:23,744 DEBUG [Listener at localhost/36741] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-15 13:22:23,744 DEBUG [Listener at localhost/36741] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-15 13:22:24,089 INFO [Listener at localhost/36741] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 13:22:24,633 INFO [Listener at localhost/36741] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=18 2023-07-15 13:22:24,675 INFO [Listener at localhost/36741] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 13:22:24,676 INFO [Listener at localhost/36741] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 13:22:24,676 INFO [Listener at localhost/36741] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 13:22:24,676 INFO [Listener at localhost/36741] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 13:22:24,676 INFO [Listener at localhost/36741] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 13:22:24,820 INFO [Listener at localhost/36741] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 13:22:24,894 DEBUG [Listener at localhost/36741] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 13:22:24,995 INFO [Listener at localhost/36741] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43297 2023-07-15 13:22:25,012 INFO [Listener at localhost/36741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 13:22:25,014 INFO [Listener at localhost/36741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 13:22:25,041 INFO [Listener at localhost/36741] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43297 connecting to ZooKeeper ensemble=127.0.0.1:64702 2023-07-15 13:22:25,088 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:432970x0, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 13:22:25,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43297-0x1016925f9a10000 connected 2023-07-15 13:22:25,162 DEBUG [Listener at localhost/36741] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 13:22:25,163 DEBUG [Listener at localhost/36741] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 13:22:25,178 DEBUG [Listener at localhost/36741] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 13:22:25,191 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43297 2023-07-15 13:22:25,191 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43297 2023-07-15 13:22:25,191 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43297 2023-07-15 13:22:25,192 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43297 2023-07-15 13:22:25,192 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43297 2023-07-15 13:22:25,229 INFO [Listener at localhost/36741] log.Log(170): Logging initialized @6335ms to org.apache.hbase.thirdparty.org.eclipse.jetty.util.log.Slf4jLog 2023-07-15 13:22:25,362 INFO [Listener at localhost/36741] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-15 13:22:25,363 INFO [Listener at localhost/36741] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-15 13:22:25,363 INFO [Listener at localhost/36741] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-15 13:22:25,365 INFO [Listener at localhost/36741] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-15 13:22:25,365 INFO [Listener at localhost/36741] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-15 13:22:25,365 INFO [Listener at localhost/36741] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-15 13:22:25,369 INFO [Listener at localhost/36741] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-15 13:22:25,426 INFO [Listener at localhost/36741] http.HttpServer(1146): Jetty bound to port 41629 2023-07-15 13:22:25,428 INFO [Listener at localhost/36741] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-15 13:22:25,460 INFO [Listener at localhost/36741] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 13:22:25,463 INFO [Listener at localhost/36741] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@5f5dbb14{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/hadoop.log.dir/,AVAILABLE} 2023-07-15 13:22:25,463 INFO [Listener at localhost/36741] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 13:22:25,464 INFO [Listener at localhost/36741] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@47d4f816{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-15 13:22:25,635 INFO [Listener at localhost/36741] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-15 13:22:25,648 INFO [Listener at localhost/36741] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-15 13:22:25,648 INFO [Listener at localhost/36741] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-15 13:22:25,650 INFO [Listener at localhost/36741] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-15 13:22:25,657 INFO [Listener at localhost/36741] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 13:22:25,684 INFO [Listener at localhost/36741] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@20d608ca{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/java.io.tmpdir/jetty-0_0_0_0-41629-hbase-server-2_4_18-SNAPSHOT_jar-_-any-5407804147222535762/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-15 13:22:25,697 INFO [Listener at localhost/36741] server.AbstractConnector(333): Started ServerConnector@203d2594{HTTP/1.1, (http/1.1)}{0.0.0.0:41629} 2023-07-15 13:22:25,697 INFO [Listener at localhost/36741] server.Server(415): Started @6803ms 2023-07-15 13:22:25,701 INFO [Listener at localhost/36741] master.HMaster(444): hbase.rootdir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268, hbase.cluster.distributed=false 2023-07-15 13:22:25,763 INFO [Listener at localhost/36741] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=18 2023-07-15 13:22:25,763 INFO [Listener at localhost/36741] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 13:22:25,764 INFO [Listener at localhost/36741] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 13:22:25,764 INFO [Listener at localhost/36741] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 13:22:25,764 INFO [Listener at localhost/36741] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 13:22:25,764 INFO [Listener at localhost/36741] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 13:22:25,769 INFO [Listener at localhost/36741] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 13:22:25,772 INFO [Listener at localhost/36741] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39981 2023-07-15 13:22:25,775 INFO [Listener at localhost/36741] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 13:22:25,782 DEBUG [Listener at localhost/36741] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 13:22:25,783 INFO [Listener at localhost/36741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 13:22:25,786 INFO [Listener at localhost/36741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 13:22:25,788 INFO [Listener at localhost/36741] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39981 connecting to ZooKeeper ensemble=127.0.0.1:64702 2023-07-15 13:22:25,797 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:399810x0, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 13:22:25,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39981-0x1016925f9a10001 connected 2023-07-15 13:22:25,799 DEBUG [Listener at localhost/36741] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 13:22:25,800 DEBUG [Listener at localhost/36741] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 13:22:25,801 DEBUG [Listener at localhost/36741] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 13:22:25,802 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39981 2023-07-15 13:22:25,802 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39981 2023-07-15 13:22:25,806 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39981 2023-07-15 13:22:25,807 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39981 2023-07-15 13:22:25,807 DEBUG [Listener at localhost/36741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39981 2023-07-15 13:22:25,811 INFO [Listener at localhost/36741] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-15 13:22:25,811 INFO [Listener at localhost/36741] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-15 13:22:25,811 INFO [Listener at localhost/36741] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-15 13:22:25,812 INFO [Listener at localhost/36741] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-15 13:22:25,813 INFO [Listener at localhost/36741] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-15 13:22:25,813 INFO [Listener at localhost/36741] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-15 13:22:25,813 INFO [Listener at localhost/36741] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-15 13:22:25,815 INFO [Listener at localhost/36741] http.HttpServer(1146): Jetty bound to port 43455 2023-07-15 13:22:25,816 INFO [Listener at localhost/36741] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-15 13:22:25,823 INFO [Listener at localhost/36741] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 13:22:25,824 INFO [Listener at localhost/36741] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@749cc6e1{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/hadoop.log.dir/,AVAILABLE} 2023-07-15 13:22:25,824 INFO [Listener at localhost/36741] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 13:22:25,824 INFO [Listener at localhost/36741] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@6e879f18{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-15 13:22:25,950 INFO [Listener at localhost/36741] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-15 13:22:25,951 INFO [Listener at localhost/36741] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-15 13:22:25,951 INFO [Listener at localhost/36741] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-15 13:22:25,951 INFO [Listener at localhost/36741] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-15 13:22:25,953 INFO [Listener at localhost/36741] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-15 13:22:25,959 INFO [Listener at localhost/36741] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@22e8009a{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/java.io.tmpdir/jetty-0_0_0_0-43455-hbase-server-2_4_18-SNAPSHOT_jar-_-any-8989623941880411574/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-15 13:22:25,960 INFO [Listener at localhost/36741] server.AbstractConnector(333): Started ServerConnector@7d7b19c4{HTTP/1.1, (http/1.1)}{0.0.0.0:43455} 2023-07-15 13:22:25,961 INFO [Listener at localhost/36741] server.Server(415): Started @7067ms 2023-07-15 13:22:25,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-15 13:22:25,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@7cd53d81{HTTP/1.1, (http/1.1)}{0.0.0.0:39573} 2023-07-15 13:22:25,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(415): Started @7080ms 2023-07-15 13:22:25,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:22:25,984 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 13:22:25,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:22:26,012 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 13:22:26,012 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 13:22:26,013 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:26,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 13:22:26,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43297,1689427343904 from backup master directory 2023-07-15 13:22:26,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 13:22:26,020 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:22:26,021 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 13:22:26,022 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 13:22:26,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:22:26,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 13:22:26,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 13:22:26,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/hbase.id with ID: 29077d91-1f57-4279-a43d-43fc3b5a421c 2023-07-15 13:22:26,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 13:22:26,182 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:26,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0e842350 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:26,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16ce03d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:26,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 13:22:26,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 13:22:26,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 13:22:26,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 13:22:26,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 13:22:26,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 13:22:26,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 13:22:26,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store-tmp 2023-07-15 13:22:26,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:26,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 13:22:26,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 13:22:26,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 13:22:26,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 13:22:26,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 13:22:26,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 13:22:26,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 13:22:26,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/WALs/jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:22:26,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43297%2C1689427343904, suffix=, logDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/WALs/jenkins-hbase4.apache.org,43297,1689427343904, archiveDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/oldWALs, maxLogs=10 2023-07-15 13:22:26,862 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-07534f14-0eaa-480d-b089-a39219afb3ac,DISK] 2023-07-15 13:22:26,869 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 13:22:26,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/WALs/jenkins-hbase4.apache.org,43297,1689427343904/jenkins-hbase4.apache.org%2C43297%2C1689427343904.1689427346820 2023-07-15 13:22:26,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44797,DS-07534f14-0eaa-480d-b089-a39219afb3ac,DISK]] 2023-07-15 13:22:26,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 13:22:26,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:26,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 13:22:26,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 13:22:27,033 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 13:22:27,039 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 13:22:27,070 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 13:22:27,082 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:27,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 13:22:27,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 13:22:27,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 13:22:27,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 13:22:27,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10405108640, jitterRate=-0.030948743224143982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 13:22:27,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 13:22:27,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 13:22:27,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 13:22:27,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 13:22:27,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 13:22:27,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 13:22:27,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-15 13:22:27,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 13:22:27,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 13:22:27,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 13:22:27,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 13:22:27,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 13:22:27,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 13:22:27,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 13:22:27,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 13:22:27,264 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:27,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 13:22:27,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 13:22:27,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 13:22:27,284 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 13:22:27,284 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 13:22:27,284 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:27,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43297,1689427343904, sessionid=0x1016925f9a10000, setting cluster-up flag (Was=false) 2023-07-15 13:22:27,303 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:27,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 13:22:27,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:22:27,316 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:27,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 13:22:27,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:22:27,326 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp 2023-07-15 13:22:27,366 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(951): ClusterId : 29077d91-1f57-4279-a43d-43fc3b5a421c 2023-07-15 13:22:27,373 DEBUG [RS:0;jenkins-hbase4:39981] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 13:22:27,379 DEBUG [RS:0;jenkins-hbase4:39981] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 13:22:27,379 DEBUG [RS:0;jenkins-hbase4:39981] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 13:22:27,382 DEBUG [RS:0;jenkins-hbase4:39981] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 13:22:27,383 DEBUG [RS:0;jenkins-hbase4:39981] zookeeper.ReadOnlyZKClient(139): Connect 0x05edec4f to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:27,389 DEBUG [RS:0;jenkins-hbase4:39981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c806781, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:27,389 DEBUG [RS:0;jenkins-hbase4:39981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42af798b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 13:22:27,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 13:22:27,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 13:22:27,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 13:22:27,420 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39981 2023-07-15 13:22:27,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=VisibilityLabelsService 2023-07-15 13:22:27,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870913. 2023-07-15 13:22:27,425 INFO [RS:0;jenkins-hbase4:39981] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 13:22:27,425 INFO [RS:0;jenkins-hbase4:39981] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 13:22:27,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870914. 2023-07-15 13:22:27,425 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 13:22:27,427 INFO [RS:0;jenkins-hbase4:39981] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 13:22:27,427 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 13:22:27,430 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43297,1689427343904 with isa=jenkins-hbase4.apache.org/172.31.14.131:39981, startcode=1689427345762 2023-07-15 13:22:27,447 DEBUG [RS:0;jenkins-hbase4:39981] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 13:22:27,504 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39461, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 13:22:27,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 13:22:27,513 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43297] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 13:22:27,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 13:22:27,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 13:22:27,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 13:22:27,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 13:22:27,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 13:22:27,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 13:22:27,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689427377526 2023-07-15 13:22:27,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 13:22:27,533 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 13:22:27,534 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 13:22:27,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 13:22:27,540 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 13:22:27,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 13:22:27,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 13:22:27,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 13:22:27,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 13:22:27,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,546 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 13:22:27,550 WARN [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 13:22:27,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 13:22:27,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 13:22:27,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 13:22:27,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 13:22:27,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 13:22:27,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689427347560,5,FailOnTimeoutGroup] 2023-07-15 13:22:27,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689427347561,5,FailOnTimeoutGroup] 2023-07-15 13:22:27,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 13:22:27,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,586 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 13:22:27,587 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 13:22:27,587 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268 2023-07-15 13:22:27,651 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43297,1689427343904 with isa=jenkins-hbase4.apache.org/172.31.14.131:39981, startcode=1689427345762 2023-07-15 13:22:27,657 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43297] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:27,666 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268 2023-07-15 13:22:27,666 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36795 2023-07-15 13:22:27,666 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=41629 2023-07-15 13:22:27,677 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 13:22:27,677 DEBUG [RS:0;jenkins-hbase4:39981] zookeeper.ZKUtil(162): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:27,678 WARN [RS:0;jenkins-hbase4:39981] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 13:22:27,678 INFO [RS:0;jenkins-hbase4:39981] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 13:22:27,681 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/WALs/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:27,683 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39981,1689427345762] 2023-07-15 13:22:27,697 DEBUG [RS:0;jenkins-hbase4:39981] zookeeper.ZKUtil(162): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:27,709 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 13:22:27,719 INFO [RS:0;jenkins-hbase4:39981] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 13:22:27,740 INFO [RS:0;jenkins-hbase4:39981] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 13:22:27,747 INFO [RS:0;jenkins-hbase4:39981] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 13:22:27,747 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,749 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 13:22:27,757 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,757 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,758 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,758 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,758 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,758 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,758 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 13:22:27,758 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,758 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,758 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,759 DEBUG [RS:0;jenkins-hbase4:39981] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 13:22:27,759 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,760 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,760 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,760 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,777 INFO [RS:0;jenkins-hbase4:39981] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 13:22:27,780 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39981,1689427345762-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,797 INFO [RS:0;jenkins-hbase4:39981] regionserver.Replication(203): jenkins-hbase4.apache.org,39981,1689427345762 started 2023-07-15 13:22:27,797 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39981,1689427345762, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39981, sessionid=0x1016925f9a10001 2023-07-15 13:22:27,797 DEBUG [RS:0;jenkins-hbase4:39981] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 13:22:27,797 DEBUG [RS:0;jenkins-hbase4:39981] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:27,797 DEBUG [RS:0;jenkins-hbase4:39981] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39981,1689427345762' 2023-07-15 13:22:27,797 DEBUG [RS:0;jenkins-hbase4:39981] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 13:22:27,798 DEBUG [RS:0;jenkins-hbase4:39981] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 13:22:27,799 DEBUG [RS:0;jenkins-hbase4:39981] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 13:22:27,799 DEBUG [RS:0;jenkins-hbase4:39981] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 13:22:27,799 DEBUG [RS:0;jenkins-hbase4:39981] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:27,799 DEBUG [RS:0;jenkins-hbase4:39981] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39981,1689427345762' 2023-07-15 13:22:27,799 DEBUG [RS:0;jenkins-hbase4:39981] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 13:22:27,799 DEBUG [RS:0;jenkins-hbase4:39981] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 13:22:27,800 DEBUG [RS:0;jenkins-hbase4:39981] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 13:22:27,800 INFO [RS:0;jenkins-hbase4:39981] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-15 13:22:27,802 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,802 DEBUG [RS:0;jenkins-hbase4:39981] zookeeper.ZKUtil(398): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-15 13:22:27,802 INFO [RS:0;jenkins-hbase4:39981] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-15 13:22:27,803 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,803 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:27,918 INFO [RS:0;jenkins-hbase4:39981] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39981%2C1689427345762, suffix=, logDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/WALs/jenkins-hbase4.apache.org,39981,1689427345762, archiveDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/oldWALs, maxLogs=32 2023-07-15 13:22:27,937 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-07534f14-0eaa-480d-b089-a39219afb3ac,DISK] 2023-07-15 13:22:27,941 INFO [RS:0;jenkins-hbase4:39981] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/WALs/jenkins-hbase4.apache.org,39981,1689427345762/jenkins-hbase4.apache.org%2C39981%2C1689427345762.1689427347920 2023-07-15 13:22:27,941 DEBUG [RS:0;jenkins-hbase4:39981] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44797,DS-07534f14-0eaa-480d-b089-a39219afb3ac,DISK]] 2023-07-15 13:22:28,004 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:28,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 13:22:28,010 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/info 2023-07-15 13:22:28,010 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 13:22:28,012 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:28,012 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 13:22:28,015 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/rep_barrier 2023-07-15 13:22:28,016 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 13:22:28,017 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:28,017 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 13:22:28,020 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/table 2023-07-15 13:22:28,020 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 13:22:28,021 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:28,023 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740 2023-07-15 13:22:28,024 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740 2023-07-15 13:22:28,028 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 13:22:28,030 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 13:22:28,034 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 13:22:28,036 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9903936000, jitterRate=-0.07762408256530762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 13:22:28,036 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 13:22:28,037 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 13:22:28,037 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 13:22:28,037 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 13:22:28,037 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 13:22:28,037 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 13:22:28,039 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 13:22:28,039 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 13:22:28,044 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 13:22:28,044 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 13:22:28,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 13:22:28,070 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 13:22:28,073 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 13:22:28,225 DEBUG [jenkins-hbase4:43297] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-15 13:22:28,227 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39981,1689427345762, state=OPENING 2023-07-15 13:22:28,235 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 13:22:28,236 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:28,237 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 13:22:28,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39981,1689427345762}] 2023-07-15 13:22:28,427 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:28,430 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 13:22:28,434 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 13:22:28,444 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 13:22:28,445 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 13:22:28,448 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39981%2C1689427345762.meta, suffix=.meta, logDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/WALs/jenkins-hbase4.apache.org,39981,1689427345762, archiveDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/oldWALs, maxLogs=32 2023-07-15 13:22:28,465 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-07534f14-0eaa-480d-b089-a39219afb3ac,DISK] 2023-07-15 13:22:28,471 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/WALs/jenkins-hbase4.apache.org,39981,1689427345762/jenkins-hbase4.apache.org%2C39981%2C1689427345762.meta.1689427348449.meta 2023-07-15 13:22:28,472 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44797,DS-07534f14-0eaa-480d-b089-a39219afb3ac,DISK]] 2023-07-15 13:22:28,472 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 13:22:28,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 13:22:28,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 13:22:28,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=VisibilityLabelsService 2023-07-15 13:22:28,481 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 13:22:28,481 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 13:22:28,484 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 13:22:28,484 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 13:22:28,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 13:22:28,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:28,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 13:22:28,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 13:22:28,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 13:22:28,503 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/info 2023-07-15 13:22:28,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/info 2023-07-15 13:22:28,504 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 13:22:28,505 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:28,505 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 13:22:28,507 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/rep_barrier 2023-07-15 13:22:28,507 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/rep_barrier 2023-07-15 13:22:28,507 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 13:22:28,508 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:28,508 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 13:22:28,509 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/table 2023-07-15 13:22:28,509 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/table 2023-07-15 13:22:28,510 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 13:22:28,511 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:28,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740 2023-07-15 13:22:28,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740 2023-07-15 13:22:28,519 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 13:22:28,522 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 13:22:28,524 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9884247680, jitterRate=-0.07945770025253296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 13:22:28,535 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:28,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 13:22:28,560 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689427348419 2023-07-15 13:22:28,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 13:22:28,580 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 13:22:28,580 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39981,1689427345762, state=OPEN 2023-07-15 13:22:28,586 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 13:22:28,586 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 13:22:28,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 13:22:28,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39981,1689427345762 in 346 msec 2023-07-15 13:22:28,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 13:22:28,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 538 msec 2023-07-15 13:22:28,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1650 sec 2023-07-15 13:22:28,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689427348600, completionTime=-1 2023-07-15 13:22:28,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-15 13:22:28,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 13:22:28,669 DEBUG [hconnection-0x64b4d5b3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:28,672 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:28,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-15 13:22:28,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689427408698 2023-07-15 13:22:28,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689427468698 2023-07-15 13:22:28,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 97 msec 2023-07-15 13:22:28,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43297,1689427343904-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:28,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43297,1689427343904-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:28,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43297,1689427343904-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:28,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43297, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:28,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:28,739 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 13:22:28,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 13:22:28,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 13:22:28,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 13:22:28,762 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 13:22:28,765 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 13:22:28,796 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:28,801 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b empty. 2023-07-15 13:22:28,802 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:28,802 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 13:22:29,236 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 13:22:29,238 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a5e454f1c63140dfb47323a41ba8198b, NAME => 'hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp 2023-07-15 13:22:29,652 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:29,652 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a5e454f1c63140dfb47323a41ba8198b, disabling compactions & flushes 2023-07-15 13:22:29,652 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:22:29,652 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:22:29,652 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. after waiting 0 ms 2023-07-15 13:22:29,652 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:22:29,652 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:22:29,652 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a5e454f1c63140dfb47323a41ba8198b: 2023-07-15 13:22:29,658 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 13:22:29,676 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689427349662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689427349662"}]},"ts":"1689427349662"} 2023-07-15 13:22:29,710 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 13:22:29,712 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 13:22:29,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427349712"}]},"ts":"1689427349712"} 2023-07-15 13:22:29,722 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 13:22:29,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a5e454f1c63140dfb47323a41ba8198b, ASSIGN}] 2023-07-15 13:22:29,736 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a5e454f1c63140dfb47323a41ba8198b, ASSIGN 2023-07-15 13:22:29,738 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a5e454f1c63140dfb47323a41ba8198b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39981,1689427345762; forceNewPlan=false, retain=false 2023-07-15 13:22:29,889 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a5e454f1c63140dfb47323a41ba8198b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:29,889 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689427349889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689427349889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689427349889"}]},"ts":"1689427349889"} 2023-07-15 13:22:29,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a5e454f1c63140dfb47323a41ba8198b, server=jenkins-hbase4.apache.org,39981,1689427345762}] 2023-07-15 13:22:30,055 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:22:30,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5e454f1c63140dfb47323a41ba8198b, NAME => 'hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b.', STARTKEY => '', ENDKEY => ''} 2023-07-15 13:22:30,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. service=AccessControlService 2023-07-15 13:22:30,058 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 13:22:30,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. service=VisibilityLabelsService 2023-07-15 13:22:30,058 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 13:22:30,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:30,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:30,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:30,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:30,062 INFO [StoreOpener-a5e454f1c63140dfb47323a41ba8198b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:30,065 DEBUG [StoreOpener-a5e454f1c63140dfb47323a41ba8198b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b/info 2023-07-15 13:22:30,065 DEBUG [StoreOpener-a5e454f1c63140dfb47323a41ba8198b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b/info 2023-07-15 13:22:30,066 INFO [StoreOpener-a5e454f1c63140dfb47323a41ba8198b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5e454f1c63140dfb47323a41ba8198b columnFamilyName info 2023-07-15 13:22:30,067 INFO [StoreOpener-a5e454f1c63140dfb47323a41ba8198b-1] regionserver.HStore(310): Store=a5e454f1c63140dfb47323a41ba8198b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:30,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:30,070 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:30,076 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:22:30,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 13:22:30,082 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a5e454f1c63140dfb47323a41ba8198b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11916844480, jitterRate=0.10984262824058533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 13:22:30,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a5e454f1c63140dfb47323a41ba8198b: 2023-07-15 13:22:30,085 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b., pid=6, masterSystemTime=1689427350048 2023-07-15 13:22:30,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:22:30,091 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:22:30,092 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a5e454f1c63140dfb47323a41ba8198b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:30,093 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689427350091"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689427350091"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689427350091"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689427350091"}]},"ts":"1689427350091"} 2023-07-15 13:22:30,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 13:22:30,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a5e454f1c63140dfb47323a41ba8198b, server=jenkins-hbase4.apache.org,39981,1689427345762 in 204 msec 2023-07-15 13:22:30,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 13:22:30,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a5e454f1c63140dfb47323a41ba8198b, ASSIGN in 369 msec 2023-07-15 13:22:30,107 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 13:22:30,108 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427350107"}]},"ts":"1689427350107"} 2023-07-15 13:22:30,111 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 13:22:30,116 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 13:22:30,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3660 sec 2023-07-15 13:22:30,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 13:22:30,164 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 13:22:30,165 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:30,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 13:22:30,230 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 13:22:30,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-07-15 13:22:30,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 13:22:30,257 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 13:22:30,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-15 13:22:30,272 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 13:22:30,274 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 13:22:30,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.252sec 2023-07-15 13:22:30,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2023-07-15 13:22:30,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 13:22:30,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2023-07-15 13:22:30,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2023-07-15 13:22:30,282 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 13:22:30,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2023-07-15 13:22:30,284 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 13:22:30,287 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,292 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b empty. 2023-07-15 13:22:30,294 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,294 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2023-07-15 13:22:30,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2023-07-15 13:22:30,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2023-07-15 13:22:30,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:30,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 13:22:30,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 13:22:30,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 13:22:30,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43297,1689427343904-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 13:22:30,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43297,1689427343904-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 13:22:30,327 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2023-07-15 13:22:30,330 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c9b5872368356a060b4893cf548cc0b, NAME => 'hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp 2023-07-15 13:22:30,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 13:22:30,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 13:22:30,344 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 13:22:30,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:30,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 1c9b5872368356a060b4893cf548cc0b, disabling compactions & flushes 2023-07-15 13:22:30,345 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:22:30,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:22:30,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. after waiting 0 ms 2023-07-15 13:22:30,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:22:30,345 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:22:30,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 1c9b5872368356a060b4893cf548cc0b: 2023-07-15 13:22:30,346 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 13:22:30,349 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:30,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 10 2023-07-15 13:22:30,350 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395 empty. 2023-07-15 13:22:30,350 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 13:22:30,350 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:30,351 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 13:22:30,352 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689427350351"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689427350351"}]},"ts":"1689427350351"} 2023-07-15 13:22:30,354 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 13:22:30,356 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 13:22:30,356 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427350356"}]},"ts":"1689427350356"} 2023-07-15 13:22:30,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-15 13:22:30,394 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2023-07-15 13:22:30,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=1c9b5872368356a060b4893cf548cc0b, ASSIGN}] 2023-07-15 13:22:30,408 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=1c9b5872368356a060b4893cf548cc0b, ASSIGN 2023-07-15 13:22:30,410 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x7aaf1408 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:30,410 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=1c9b5872368356a060b4893cf548cc0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39981,1689427345762; forceNewPlan=false, retain=false 2023-07-15 13:22:30,415 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@512d5b32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:30,429 DEBUG [hconnection-0x107f1fb9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:30,440 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:30,443 INFO [Listener at localhost/36741] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:22:30,443 DEBUG [Listener at localhost/36741] client.AbstractTestShell(63): Configure jruby runtime, cluster set to org.apache.hadoop.hbase.HBaseTestingUtility@4154fa59 2023-07-15 13:22:30,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1c9b5872368356a060b4893cf548cc0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:30,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689427350562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689427350562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689427350562"}]},"ts":"1689427350562"} 2023-07-15 13:22:30,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 1c9b5872368356a060b4893cf548cc0b, server=jenkins-hbase4.apache.org,39981,1689427345762}] 2023-07-15 13:22:30,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-15 13:22:30,725 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:22:30,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c9b5872368356a060b4893cf548cc0b, NAME => 'hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b.', STARTKEY => '', ENDKEY => ''} 2023-07-15 13:22:30,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. service=AccessControlService 2023-07-15 13:22:30,726 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 13:22:30,726 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. service=VisibilityLabelsService 2023-07-15 13:22:30,726 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 13:22:30,726 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,726 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:30,726 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,726 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,728 INFO [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,730 DEBUG [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/q 2023-07-15 13:22:30,730 DEBUG [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/q 2023-07-15 13:22:30,731 INFO [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c9b5872368356a060b4893cf548cc0b columnFamilyName q 2023-07-15 13:22:30,731 INFO [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] regionserver.HStore(310): Store=1c9b5872368356a060b4893cf548cc0b/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:30,731 INFO [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,733 DEBUG [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/u 2023-07-15 13:22:30,733 DEBUG [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/u 2023-07-15 13:22:30,734 INFO [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c9b5872368356a060b4893cf548cc0b columnFamilyName u 2023-07-15 13:22:30,735 INFO [StoreOpener-1c9b5872368356a060b4893cf548cc0b-1] regionserver.HStore(310): Store=1c9b5872368356a060b4893cf548cc0b/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:30,737 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,738 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 13:22:30,745 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:22:30,751 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 13:22:30,752 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c9b5872368356a060b4893cf548cc0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10169237600, jitterRate=-0.052915945649147034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 13:22:30,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c9b5872368356a060b4893cf548cc0b: 2023-07-15 13:22:30,754 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b., pid=12, masterSystemTime=1689427350719 2023-07-15 13:22:30,758 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:22:30,758 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:22:30,759 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1c9b5872368356a060b4893cf548cc0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:30,759 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689427350758"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689427350758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689427350758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689427350758"}]},"ts":"1689427350758"} 2023-07-15 13:22:30,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-07-15 13:22:30,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 1c9b5872368356a060b4893cf548cc0b, server=jenkins-hbase4.apache.org,39981,1689427345762 in 197 msec 2023-07-15 13:22:30,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=9 2023-07-15 13:22:30,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=1c9b5872368356a060b4893cf548cc0b, ASSIGN in 364 msec 2023-07-15 13:22:30,773 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 13:22:30,773 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427350773"}]},"ts":"1689427350773"} 2023-07-15 13:22:30,776 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2023-07-15 13:22:30,779 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 13:22:30,779 WARN [PEWorker-5] access.AccessController(784): Not adding owner permission for table hbase:quota. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-15 13:22:30,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 502 msec 2023-07-15 13:22:30,811 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 13:22:30,813 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8a8843ee9b899bc9176c5225b6bc7395, NAME => 'hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp 2023-07-15 13:22:31,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-15 13:22:31,232 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:31,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 8a8843ee9b899bc9176c5225b6bc7395, disabling compactions & flushes 2023-07-15 13:22:31,233 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:22:31,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:22:31,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. after waiting 0 ms 2023-07-15 13:22:31,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:22:31,233 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:22:31,233 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 8a8843ee9b899bc9176c5225b6bc7395: 2023-07-15 13:22:31,238 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 13:22:31,240 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689427351240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689427351240"}]},"ts":"1689427351240"} 2023-07-15 13:22:31,243 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 13:22:31,245 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 13:22:31,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427351245"}]},"ts":"1689427351245"} 2023-07-15 13:22:31,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 13:22:31,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8a8843ee9b899bc9176c5225b6bc7395, ASSIGN}] 2023-07-15 13:22:31,260 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8a8843ee9b899bc9176c5225b6bc7395, ASSIGN 2023-07-15 13:22:31,261 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=8a8843ee9b899bc9176c5225b6bc7395, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39981,1689427345762; forceNewPlan=false, retain=false 2023-07-15 13:22:31,412 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8a8843ee9b899bc9176c5225b6bc7395, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:31,413 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689427351412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689427351412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689427351412"}]},"ts":"1689427351412"} 2023-07-15 13:22:31,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 8a8843ee9b899bc9176c5225b6bc7395, server=jenkins-hbase4.apache.org,39981,1689427345762}] 2023-07-15 13:22:31,575 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:22:31,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a8843ee9b899bc9176c5225b6bc7395, NAME => 'hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395.', STARTKEY => '', ENDKEY => ''} 2023-07-15 13:22:31,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. service=AccessControlService 2023-07-15 13:22:31,577 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 13:22:31,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. service=VisibilityLabelsService 2023-07-15 13:22:31,577 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 13:22:31,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:31,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:31,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:31,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:31,580 INFO [StoreOpener-8a8843ee9b899bc9176c5225b6bc7395-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:31,582 DEBUG [StoreOpener-8a8843ee9b899bc9176c5225b6bc7395-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395/l 2023-07-15 13:22:31,582 DEBUG [StoreOpener-8a8843ee9b899bc9176c5225b6bc7395-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395/l 2023-07-15 13:22:31,583 INFO [StoreOpener-8a8843ee9b899bc9176c5225b6bc7395-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a8843ee9b899bc9176c5225b6bc7395 columnFamilyName l 2023-07-15 13:22:31,584 INFO [StoreOpener-8a8843ee9b899bc9176c5225b6bc7395-1] regionserver.HStore(310): Store=8a8843ee9b899bc9176c5225b6bc7395/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:31,586 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:31,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:31,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:22:31,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 13:22:31,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a8843ee9b899bc9176c5225b6bc7395; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10265604000, jitterRate=-0.04394112527370453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 13:22:31,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a8843ee9b899bc9176c5225b6bc7395: 2023-07-15 13:22:31,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395., pid=14, masterSystemTime=1689427351569 2023-07-15 13:22:31,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:22:31,605 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:22:31,605 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8a8843ee9b899bc9176c5225b6bc7395, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:31,606 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689427351605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689427351605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689427351605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689427351605"}]},"ts":"1689427351605"} 2023-07-15 13:22:31,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-15 13:22:31,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 8a8843ee9b899bc9176c5225b6bc7395, server=jenkins-hbase4.apache.org,39981,1689427345762 in 193 msec 2023-07-15 13:22:31,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-07-15 13:22:31,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=8a8843ee9b899bc9176c5225b6bc7395, ASSIGN in 354 msec 2023-07-15 13:22:31,617 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 13:22:31,618 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427351617"}]},"ts":"1689427351617"} 2023-07-15 13:22:31,620 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 13:22:31,624 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 13:22:31,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=hbase:acl in 1.2880 sec 2023-07-15 13:22:31,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=10 2023-07-15 13:22:31,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 10 completed 2023-07-15 13:22:31,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 13:22:31,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:labels 2023-07-15 13:22:31,940 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 13:22:31,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "labels" procId is: 15 2023-07-15 13:22:31,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-15 13:22:31,942 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 13:22:31,944 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:31,945 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117 empty. 2023-07-15 13:22:31,946 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:31,946 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:labels regions 2023-07-15 13:22:32,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-15 13:22:32,363 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/hbase/labels/.tabledesc/.tableinfo.0000000001 2023-07-15 13:22:32,366 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3bd5aeb70d48855e421f4d521b70117, NAME => 'hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp 2023-07-15 13:22:32,390 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(866): Instantiated hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:32,391 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1604): Closing c3bd5aeb70d48855e421f4d521b70117, disabling compactions & flushes 2023-07-15 13:22:32,391 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1626): Closing region hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:22:32,391 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:22:32,391 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. after waiting 0 ms 2023-07-15 13:22:32,391 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:22:32,391 INFO [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1838): Closed hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:22:32,391 DEBUG [RegionOpenAndInit-hbase:labels-pool-0] regionserver.HRegion(1558): Region close journal for c3bd5aeb70d48855e421f4d521b70117: 2023-07-15 13:22:32,395 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 13:22:32,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689427352397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689427352397"}]},"ts":"1689427352397"} 2023-07-15 13:22:32,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 13:22:32,401 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 13:22:32,402 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427352402"}]},"ts":"1689427352402"} 2023-07-15 13:22:32,404 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLING in hbase:meta 2023-07-15 13:22:32,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=c3bd5aeb70d48855e421f4d521b70117, ASSIGN}] 2023-07-15 13:22:32,411 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:labels, region=c3bd5aeb70d48855e421f4d521b70117, ASSIGN 2023-07-15 13:22:32,412 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:labels, region=c3bd5aeb70d48855e421f4d521b70117, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39981,1689427345762; forceNewPlan=false, retain=false 2023-07-15 13:22:32,563 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c3bd5aeb70d48855e421f4d521b70117, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:32,564 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689427352563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689427352563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689427352563"}]},"ts":"1689427352563"} 2023-07-15 13:22:32,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure c3bd5aeb70d48855e421f4d521b70117, server=jenkins-hbase4.apache.org,39981,1689427345762}] 2023-07-15 13:22:32,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-15 13:22:32,728 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:22:32,728 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3bd5aeb70d48855e421f4d521b70117, NAME => 'hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117.', STARTKEY => '', ENDKEY => ''} 2023-07-15 13:22:32,729 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. service=AccessControlService 2023-07-15 13:22:32,729 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 13:22:32,729 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. service=VisibilityLabelsService 2023-07-15 13:22:32,730 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 13:22:32,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table labels c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:32,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:32,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:32,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:32,734 INFO [StoreOpener-c3bd5aeb70d48855e421f4d521b70117-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:32,736 DEBUG [StoreOpener-c3bd5aeb70d48855e421f4d521b70117-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117/f 2023-07-15 13:22:32,736 DEBUG [StoreOpener-c3bd5aeb70d48855e421f4d521b70117-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117/f 2023-07-15 13:22:32,737 INFO [StoreOpener-c3bd5aeb70d48855e421f4d521b70117-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3bd5aeb70d48855e421f4d521b70117 columnFamilyName f 2023-07-15 13:22:32,738 INFO [StoreOpener-c3bd5aeb70d48855e421f4d521b70117-1] regionserver.HStore(310): Store=c3bd5aeb70d48855e421f4d521b70117/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:32,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:32,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:32,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:22:32,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 13:22:32,757 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3bd5aeb70d48855e421f4d521b70117; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@3f36d563, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 13:22:32,771 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2023-07-15 13:22:32,774 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3bd5aeb70d48855e421f4d521b70117: 2023-07-15 13:22:32,777 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117., pid=17, masterSystemTime=1689427352722 2023-07-15 13:22:32,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(686): ZK sync() operation took 8ms 2023-07-15 13:22:32,780 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:22:32,780 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:22:32,782 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c3bd5aeb70d48855e421f4d521b70117, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:32,782 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117.","families":{"info":[{"qualifier":"regioninfo","vlen":38,"tag":[],"timestamp":"1689427352781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689427352781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689427352781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689427352781"}]},"ts":"1689427352781"} 2023-07-15 13:22:32,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-15 13:22:32,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure c3bd5aeb70d48855e421f4d521b70117, server=jenkins-hbase4.apache.org,39981,1689427345762 in 218 msec 2023-07-15 13:22:32,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-15 13:22:32,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=hbase:labels, region=c3bd5aeb70d48855e421f4d521b70117, ASSIGN in 383 msec 2023-07-15 13:22:32,795 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 13:22:32,796 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:labels","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427352796"}]},"ts":"1689427352796"} 2023-07-15 13:22:32,798 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:labels, state=ENABLED in hbase:meta 2023-07-15 13:22:32,806 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:labels execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 13:22:32,813 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey hbase:labels jenkins.hfs.0: RWXCA 2023-07-15 13:22:32,845 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39981] access.PermissionStorage(611): Read acl: entry[hbase:labels], kv [jenkins.hfs.0: RWXCA] 2023-07-15 13:22:32,892 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 13:22:32,893 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 13:22:32,893 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:22:32,903 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/hbase:labels 2023-07-15 13:22:32,904 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/hbase:labels 2023-07-15 13:22:32,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-15 13:22:32,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-15 13:22:32,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; CreateTableProcedure table=hbase:labels in 967 msec 2023-07-15 13:22:33,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-07-15 13:22:33,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:labels, procId: 15 completed 2023-07-15 13:22:33,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 13:22:33,700 INFO [Listener at localhost/36741] hbase.ResourceChecker(147): before: client.TestQuotasShell#testRunShellTests Thread=238, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=173, AvailableMemoryMB=4978 2023-07-15 13:22:33,702 INFO [Listener at localhost/36741] client.AbstractTestShell(93): Starting ruby tests. includes: quotas_test.rb excludes: 2023-07-15 13:22:34,043 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 13:22:34,120 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 13:22:34,123 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 13:22:34,125 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:labels' 2023-07-15 13:22:34,126 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 13:22:34,127 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2023-07-15 13:22:34,130 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:22:34,131 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 13:22:34,131 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:22:34,131 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase RegionObservers 2023-07-15 13:22:34,132 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:22:34,132 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 13:22:34,132 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:22:34,132 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 13:22:34,132 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 13:22:34,132 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 13:22:34,133 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-15 13:22:34,133 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2023-07-15 13:22:34,133 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 13:22:34,133 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 13:22:34,133 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:22:34,133 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController Metrics about HBase MasterObservers Ruby description: jruby 9.2.13.0 (2.5.7) 2020-08-03 9a89c94bcc OpenJDK 64-Bit Server VM 25.362-b09 on 1.8.0_362-b09 +jit [linux-x86_64] uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag uri:classloader:/META-INF/jruby.home/lib/ruby/gems/shared/gems/power_assert-1.1.3/lib/power_assert.rb:8: warning: tracing (e.g. set_trace_func) will not capture all events without --debug flag Running tests... Skip commands_test.rb because of not included Skip formatter_test.rb because of not included Skip converter_test.rb because of not included Skip list_locks_test.rb because of not included Skip list_procedures_test.rb because of not included Skip rsgroup_shell_test.rb because of not included Skip noninteractive_test.rb because of not included Skip shell_test.rb because of not included Skip table_test.rb because of not included Skip admin2_test.rb because of not included Skip hbase_test.rb because of not included Skip taskmonitor_test.rb because of not included Skip admin_test.rb because of not included Skip replication_admin_test.rb because of not included loading test file 'quotas_test.rb'. Skip security_admin_test.rb because of not included Skip visibility_labels_admin_test.rb because of not included Loaded suite src/test/ruby/tests_runner Started 2023-07-15 13:22:36,970 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x63f46d26 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:36,979 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f67c7af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:37,011 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:37,016 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:37,033 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:22:37,039 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 13:22:37,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 13:22:37,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase_shell_quota_tests_table 2023-07-15 13:22:37,052 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 13:22:37,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "hbase_shell_quota_tests_table" procId is: 18 2023-07-15 13:22:37,055 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 13:22:37,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-15 13:22:37,062 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,064 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3 empty. 2023-07-15 13:22:37,065 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,065 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase_shell_quota_tests_table regions 2023-07-15 13:22:37,102 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp/data/default/hbase_shell_quota_tests_table/.tabledesc/.tableinfo.0000000001 2023-07-15 13:22:37,105 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(7675): creating {ENCODED => b9ba85199b5b1a9478e6ac08effc1eb3, NAME => 'hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase_shell_quota_tests_table', {NAME => 'x', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '5', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'y', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.tmp 2023-07-15 13:22:37,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-15 13:22:37,526 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:37,527 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1604): Closing b9ba85199b5b1a9478e6ac08effc1eb3, disabling compactions & flushes 2023-07-15 13:22:37,527 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:37,527 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:37,527 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. after waiting 0 ms 2023-07-15 13:22:37,527 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:37,527 INFO [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:37,527 DEBUG [RegionOpenAndInit-hbase_shell_quota_tests_table-pool-0] regionserver.HRegion(1558): Region close journal for b9ba85199b5b1a9478e6ac08effc1eb3: 2023-07-15 13:22:37,532 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 13:22:37,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689427357533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689427357533"}]},"ts":"1689427357533"} 2023-07-15 13:22:37,536 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 13:22:37,538 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 13:22:37,538 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427357538"}]},"ts":"1689427357538"} 2023-07-15 13:22:37,540 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLING in hbase:meta 2023-07-15 13:22:37,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=b9ba85199b5b1a9478e6ac08effc1eb3, ASSIGN}] 2023-07-15 13:22:37,547 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=b9ba85199b5b1a9478e6ac08effc1eb3, ASSIGN 2023-07-15 13:22:37,548 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=b9ba85199b5b1a9478e6ac08effc1eb3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39981,1689427345762; forceNewPlan=false, retain=false 2023-07-15 13:22:37,699 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b9ba85199b5b1a9478e6ac08effc1eb3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:37,700 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689427357699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689427357699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689427357699"}]},"ts":"1689427357699"} 2023-07-15 13:22:37,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure b9ba85199b5b1a9478e6ac08effc1eb3, server=jenkins-hbase4.apache.org,39981,1689427345762}] 2023-07-15 13:22:37,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-15 13:22:37,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:37,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9ba85199b5b1a9478e6ac08effc1eb3, NAME => 'hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.', STARTKEY => '', ENDKEY => ''} 2023-07-15 13:22:37,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. service=AccessControlService 2023-07-15 13:22:37,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 13:22:37,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. service=VisibilityLabelsService 2023-07-15 13:22:37,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController loaded, priority=536870912. 2023-07-15 13:22:37,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table hbase_shell_quota_tests_table b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 13:22:37,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,867 INFO [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family x of region b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,870 DEBUG [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x 2023-07-15 13:22:37,870 DEBUG [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x 2023-07-15 13:22:37,870 INFO [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9ba85199b5b1a9478e6ac08effc1eb3 columnFamilyName x 2023-07-15 13:22:37,871 INFO [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] regionserver.HStore(310): Store=b9ba85199b5b1a9478e6ac08effc1eb3/x, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:37,871 INFO [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family y of region b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,874 DEBUG [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/y 2023-07-15 13:22:37,874 DEBUG [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/y 2023-07-15 13:22:37,875 INFO [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9ba85199b5b1a9478e6ac08effc1eb3 columnFamilyName y 2023-07-15 13:22:37,876 INFO [StoreOpener-b9ba85199b5b1a9478e6ac08effc1eb3-1] regionserver.HStore(310): Store=b9ba85199b5b1a9478e6ac08effc1eb3/y, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 13:22:37,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase_shell_quota_tests_table descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-15 13:22:37,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:22:37,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 13:22:37,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b9ba85199b5b1a9478e6ac08effc1eb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10947194560, jitterRate=0.01953694224357605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-15 13:22:37,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b9ba85199b5b1a9478e6ac08effc1eb3: 2023-07-15 13:22:37,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3., pid=20, masterSystemTime=1689427357857 2023-07-15 13:22:37,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:37,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:37,908 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b9ba85199b5b1a9478e6ac08effc1eb3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:37,908 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689427357908"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689427357908"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689427357908"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689427357908"}]},"ts":"1689427357908"} 2023-07-15 13:22:37,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-15 13:22:37,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure b9ba85199b5b1a9478e6ac08effc1eb3, server=jenkins-hbase4.apache.org,39981,1689427345762 in 208 msec 2023-07-15 13:22:37,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=18 2023-07-15 13:22:37,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=hbase_shell_quota_tests_table, region=b9ba85199b5b1a9478e6ac08effc1eb3, ASSIGN in 370 msec 2023-07-15 13:22:37,920 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 13:22:37,920 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase_shell_quota_tests_table","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689427357920"}]},"ts":"1689427357920"} 2023-07-15 13:22:37,922 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase_shell_quota_tests_table, state=ENABLED in hbase:meta 2023-07-15 13:22:37,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase_shell_quota_tests_table execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 13:22:37,926 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey hbase_shell_quota_tests_table jenkins: RWXCA 2023-07-15 13:22:37,928 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39981] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-15 13:22:37,931 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 13:22:37,931 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 13:22:37,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-15 13:22:37,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-15 13:22:37,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase:labels with data PBUF\x0A0\x0A\x0Djenkins.hfs.0\x12\x1F\x08\x03"\x1B\x0A\x0F\x0A\x05hbase\x12\x06labels \x00 \x01 \x02 \x03 \x04 2023-07-15 13:22:37,935 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from hbase_shell_quota_tests_table with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dhbase_shell_quota_tests_table \x00 \x01 \x02 \x03 \x04 2023-07-15 13:22:37,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; CreateTableProcedure table=hbase_shell_quota_tests_table in 886 msec 2023-07-15 13:22:38,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-07-15 13:22:38,563 INFO [Listener at localhost/36741] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:hbase_shell_quota_tests_table, procId: 18 completed Created table hbase_shell_quota_tests_table Took 1.5448 seconds Took 0.0390 seconds 2023-07-15 13:22:38,670 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x2b1ec3ca to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:38,675 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@350d65ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:38,678 DEBUG [hconnection-0x46353c36-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:38,682 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:38,693 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b1ec3ca to 127.0.0.1:64702 2023-07-15 13:22:38,693 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0055 seconds 2023-07-15 13:22:38,703 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x63dd6d52 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:38,709 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7818a3b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:38,711 DEBUG [hconnection-0x1d3c92f0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:38,714 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:38,721 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63dd6d52 to 127.0.0.1:64702 2023-07-15 13:22:38,721 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0075 seconds 2023-07-15 13:22:38,731 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x5c582ed5 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:38,745 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22ca796c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:38,748 DEBUG [hconnection-0x382bdf67-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:38,752 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:38,758 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c582ed5 to 127.0.0.1:64702 2023-07-15 13:22:38,759 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:38,761 INFO [Listener at localhost/36741] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:22:38,762 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63f46d26 to 127.0.0.1:64702 2023-07-15 13:22:38,763 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:22:38,766 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x347ab68b to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:38,775 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@174631f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:38,777 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:38,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:38,805 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:22:38,813 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0268 seconds 2023-07-15 13:22:38,823 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x6a7d93db to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:38,830 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dfc22ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:38,835 DEBUG [hconnection-0x1de1a4f0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:38,839 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:38,846 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a7d93db to 127.0.0.1:64702 2023-07-15 13:22:38,846 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0076 seconds 2023-07-15 13:22:38,858 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x026af962 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:38,886 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16728c7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:38,889 DEBUG [hconnection-0x2534c750-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:38,892 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:38,898 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x026af962 to 127.0.0.1:64702 2023-07-15 13:22:38,899 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:38,901 INFO [Listener at localhost/36741] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:22:38,901 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x347ab68b to 127.0.0.1:64702 2023-07-15 13:22:38,901 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:22:38,903 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x2cb23509 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:38,912 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a4c6b25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:38,919 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:38,923 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:38,929 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:22:38,943 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0242 seconds 2023-07-15 13:22:38,953 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x0411f279 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:38,979 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3936958f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:38,985 DEBUG [hconnection-0x302ac4cf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:38,989 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,001 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0411f279 to 127.0.0.1:64702 2023-07-15 13:22:39,001 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0073 seconds 2023-07-15 13:22:39,012 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x5535b19e to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,026 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@579e4c2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,107 DEBUG [hconnection-0x63d5079a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,111 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,117 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5535b19e to 127.0.0.1:64702 2023-07-15 13:22:39,118 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0049 seconds 2023-07-15 13:22:39,126 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x7e7b572b to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,133 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f2d30c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,136 DEBUG [hconnection-0x6341bbaf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,139 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,143 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e7b572b to 127.0.0.1:64702 2023-07-15 13:22:39,144 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:39,145 INFO [Listener at localhost/36741] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:22:39,145 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cb23509 to 127.0.0.1:64702 2023-07-15 13:22:39,146 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:22:39,147 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x0121abaf to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,154 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2578d7d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,156 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,159 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,165 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:22:39,167 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0080 seconds 2023-07-15 13:22:39,173 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x77be8d48 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,179 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6adba970, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,183 DEBUG [hconnection-0x975719f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,186 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,192 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77be8d48 to 127.0.0.1:64702 2023-07-15 13:22:39,193 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0080 seconds 2023-07-15 13:22:39,206 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x1ea37de9 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,211 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58211f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,299 DEBUG [hconnection-0x6302e3c0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,301 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,307 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ea37de9 to 127.0.0.1:64702 2023-07-15 13:22:39,307 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:39,309 INFO [Listener at localhost/36741] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:22:39,310 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0121abaf to 127.0.0.1:64702 2023-07-15 13:22:39,310 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:22:39,313 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x609a06ae to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,321 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30ac351b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,324 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,326 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,331 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:22:39,332 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0072 seconds 2023-07-15 13:22:39,338 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x06ac4b75 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,343 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36339278, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,345 DEBUG [hconnection-0x67667d48-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,347 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,353 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06ac4b75 to 127.0.0.1:64702 2023-07-15 13:22:39,353 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client Took 0.0052 seconds 2023-07-15 13:22:39,365 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x5ce68986 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,371 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47e1b174, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,374 DEBUG [hconnection-0x42b4b14b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,376 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,381 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ce68986 to 127.0.0.1:64702 2023-07-15 13:22:39,382 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:39,383 INFO [Listener at localhost/36741] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:22:39,384 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x609a06ae to 127.0.0.1:64702 2023-07-15 13:22:39,384 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:22:39,386 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x6bb8ce52 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:39,390 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@119f7e62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:39,392 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:39,393 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:39,398 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:22:39,401 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0080 seconds 2023-07-15 13:22:39,425 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:22:39,427 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService Took 0.0205 seconds Took 0.0027 seconds Took 0.0026 seconds Took 0.0023 seconds Took 0.0021 seconds Took 0.0020 seconds Took 0.0019 seconds Took 0.0021 seconds Took 0.0017 seconds Took 0.0018 seconds 2023-07-15 13:22:39,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 13:22:39,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-15 13:22:39,490 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-15 13:22:39,490 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 13:22:39,491 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-15 13:22:39,491 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-15 13:22:39,492 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:39,492 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:39,493 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 13:22:39,493 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:39,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 13:22:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 13:22:39,494 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:39,494 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 13:22:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:39,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 13:22:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:39,496 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-15 13:22:39,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-15 13:22:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-15 13:22:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 13:22:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-15 13:22:39,501 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 13:22:39,501 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:39,501 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 13:22:39,501 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. started... 2023-07-15 13:22:39,502 INFO [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b9ba85199b5b1a9478e6ac08effc1eb3 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-15 13:22:39,984 INFO [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=14 (bloomFilter=true), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/.tmp/x/e1ebbfaf144941a9a085b3dab4bd8646 2023-07-15 13:22:40,034 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/.tmp/x/e1ebbfaf144941a9a085b3dab4bd8646 as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/e1ebbfaf144941a9a085b3dab4bd8646 2023-07-15 13:22:40,043 INFO [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/e1ebbfaf144941a9a085b3dab4bd8646, entries=10, sequenceid=14, filesize=5.0 K 2023-07-15 13:22:40,046 INFO [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for b9ba85199b5b1a9478e6ac08effc1eb3 in 544ms, sequenceid=14, compaction requested=false 2023-07-15 13:22:40,046 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase_shell_quota_tests_table' 2023-07-15 13:22:40,048 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b9ba85199b5b1a9478e6ac08effc1eb3: 2023-07-15 13:22:40,048 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:40,048 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 13:22:40,049 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 13:22:40,049 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,049 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-15 13:22:40,049 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39981,1689427345762' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-15 13:22:40,051 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:40,051 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:40,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 13:22:40,052 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:40,052 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 13:22:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:40,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39981,1689427345762' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-15 13:22:40,053 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-15 13:22:40,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e816d01[Count = 0] remaining members to acquire global barrier 2023-07-15 13:22:40,054 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:40,055 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:40,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:40,055 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-15 13:22:40,055 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-15 13:22:40,055 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,39981,1689427345762' in zk 2023-07-15 13:22:40,055 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,055 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 13:22:40,058 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-15 13:22:40,058 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,058 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 13:22:40,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:40,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 13:22:40,059 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-15 13:22:40,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:40,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:40,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:40,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:40,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:40,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,39981,1689427345762': 2023-07-15 13:22:40,062 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-15 13:22:40,062 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 13:22:40,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39981,1689427345762' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-15 13:22:40,062 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 13:22:40,062 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-15 13:22:40,062 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 13:22:40,064 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:40,064 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:40,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:40,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:40,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:40,064 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 13:22:40,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 13:22:40,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 13:22:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 13:22:40,065 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:40,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:40,067 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:40,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:40,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,073 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,073 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 13:22:40,073 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 13:22:40,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 13:22:40,073 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 13:22:40,073 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:40,073 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 13:22:40,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-15 13:22:40,073 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 13:22:40,074 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:40,074 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:40,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 13:22:40,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 13:22:40,074 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:40,076 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-15 13:22:40,076 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 13:22:40,326 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 13:22:40,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.8804 seconds 2023-07-15 13:22:40,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 13:22:40,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689427360349 (current time:1689427360349). 2023-07-15 13:22:40,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 13:22:40,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ReadOnlyZKClient(139): Connect 0x06199d27 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:40,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b767d4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:40,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:40,358 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:40,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06199d27 to 127.0.0.1:64702 2023-07-15 13:22:40,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:40,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ReadOnlyZKClient(139): Connect 0x6417d6a7 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:40,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40a9b366, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:40,365 DEBUG [hconnection-0x3e675898-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:40,367 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:40,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6417d6a7 to 127.0.0.1:64702 2023-07-15 13:22:40,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:40,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-15 13:22:40,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 13:22:40,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 13:22:40,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 13:22:40,415 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=21, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 13:22:40,416 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=21, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1689427960416 2023-07-15 13:22:40,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 13:22:40,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-15 13:22:40,417 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=21, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 13:22:40,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 13:22:40,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 11 msec 2023-07-15 13:22:40,420 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 13:22:40,420 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1689427960420 2023-07-15 13:22:40,422 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-15 13:22:40,422 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-15 13:22:40,673 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 13:22:40,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 13:22:40,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 13:22:40,680 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 13:22:40,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,836 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_1' 2023-07-15 13:22:40,836 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 13:22:40,836 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_1' starting 'acquire' 2023-07-15 13:22:40,836 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_1', kicking off acquire phase on members. 2023-07-15 13:22:40,837 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,837 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,838 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,838 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 13:22:40,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 13:22:40,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 13:22:40,839 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,839 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 13:22:40,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-15 13:22:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_1 from table hbase_shell_quota_tests_table type FLUSH 2023-07-15 13:22:40,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,843 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_1' with timeout 300000ms 2023-07-15 13:22:40,843 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 13:22:40,843 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_1' starting 'acquire' stage 2023-07-15 13:22:40,843 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_1' locally acquired 2023-07-15 13:22:40,843 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39981,1689427345762' joining acquired barrier for procedure (hbase_shell_quota_tests_table_1) in zk 2023-07-15 13:22:40,847 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,847 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:40,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 13:22:40,847 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,847 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 13:22:40,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:40,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:40,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:40,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39981,1689427345762' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_1' on coordinator 2023-07-15 13:22:40,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@632bb7ff[Count = 0] remaining members to acquire global barrier 2023-07-15 13:22:40,849 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_1' starting 'in-barrier' execution. 2023-07-15 13:22:40,849 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,851 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,851 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_1' received 'reached' from coordinator. 2023-07-15 13:22:40,851 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:40,851 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 13:22:40,852 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 13:22:40,852 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 13:22:40,852 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:40,853 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. started... 2023-07-15 13:22:40,853 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b9ba85199b5b1a9478e6ac08effc1eb3: 2023-07-15 13:22:40,854 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.' region-info for snapshot=hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,860 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 13:22:40,863 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/e1ebbfaf144941a9a085b3dab4bd8646] hfiles 2023-07-15 13:22:40,863 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/e1ebbfaf144941a9a085b3dab4bd8646 for snapshot=hbase_shell_quota_tests_table_1 2023-07-15 13:22:40,867 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 13:22:41,181 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 13:22:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 13:22:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 13:22:41,183 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-15 13:22:41,279 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. completed. 2023-07-15 13:22:41,279 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 13:22:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 13:22:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_1' locally completed 2023-07-15 13:22:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_1' completed for member 'jenkins-hbase4.apache.org,39981,1689427345762' in zk 2023-07-15 13:22:41,282 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_1' has notified controller of completion 2023-07-15 13:22:41,282 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,282 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 13:22:41,282 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_1' completed. 2023-07-15 13:22:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 13:22:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:41,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_1' member 'jenkins-hbase4.apache.org,39981,1689427345762': 2023-07-15 13:22:41,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39981,1689427345762' released barrier for procedure'hbase_shell_quota_tests_table_1', counting down latch. Waiting for 0 more 2023-07-15 13:22:41,286 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_1' execution completed 2023-07-15 13:22:41,286 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 13:22:41,286 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 13:22:41,286 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,286 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 13:22:41,288 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,288 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,288 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 13:22:41,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:41,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 13:22:41,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 13:22:41,289 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 13:22:41,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:41,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:41,290 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,299 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,299 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 13:22:41,299 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 13:22:41,299 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,299 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 13:22:41,299 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 13:22:41,300 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:41,300 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 13:22:41,300 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,300 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 because node does not exist (not an error) 2023-07-15 13:22:41,301 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 13:22:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 13:22:41,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 to hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/hbase_shell_quota_tests_table_1 2023-07-15 13:22:41,934 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 13:22:41,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 13:22:41,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 13:22:41,936 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2428): (#4) Sleeping: 1250ms while waiting for snapshot completion. 2023-07-15 13:22:42,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed 2023-07-15 13:22:42,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-15 13:22:42,168 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_1 2023-07-15 13:22:42,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_1 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1689427360416Consolidate snapshot: hbase_shell_quota_tests_table_1 at 1689427361300 (+884 ms)Loading Region manifests for hbase_shell_quota_tests_table_1 at 1689427361301 (+1 ms)Writing data manifest for hbase_shell_quota_tests_table_1 at 1689427361313 (+12 ms)Verifying snapshot: hbase_shell_quota_tests_table_1 at 1689427361328 (+15 ms)Snapshot hbase_shell_quota_tests_table_1 of table hbase_shell_quota_tests_table completed at 1689427362168 (+840 ms) 2023-07-15 13:22:42,170 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 13:22:42,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 1.7530 sec 2023-07-15 13:22:43,186 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 13:22:43,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 13:22:43,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_1 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 2.8510 seconds Took 0.0025 seconds Took 0.0023 seconds Took 0.0018 seconds Took 0.0017 seconds Took 0.0018 seconds Took 0.0027 seconds Took 0.0017 seconds Took 0.0016 seconds Took 0.0017 seconds Took 0.0016 seconds 2023-07-15 13:22:43,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-07-15 13:22:43,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] procedure.ProcedureCoordinator(143): Procedure hbase_shell_quota_tests_table was in running list but was completed. Accepting new attempt. 2023-07-15 13:22:43,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table 2023-07-15 13:22:43,228 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table' 2023-07-15 13:22:43,228 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 13:22:43,229 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table' starting 'acquire' 2023-07-15 13:22:43,229 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table', kicking off acquire phase on members. 2023-07-15 13:22:43,230 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,230 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:43,231 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 13:22:43,231 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 13:22:43,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 13:22:43,232 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,232 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 13:22:43,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:43,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-15 13:22:43,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:43,233 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for hbase_shell_quota_tests_table 2023-07-15 13:22:43,233 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc hbase_shell_quota_tests_table is still present, removing 2023-07-15 13:22:43,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table 2023-07-15 13:22:43,233 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table' with timeout 60000ms 2023-07-15 13:22:43,233 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-15 13:22:43,234 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table' starting 'acquire' stage 2023-07-15 13:22:43,234 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-15 13:22:43,234 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-15 13:22:43,234 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:43,234 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. started... 2023-07-15 13:22:43,234 INFO [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b9ba85199b5b1a9478e6ac08effc1eb3 2/2 column families, dataSize=242 B heapSize=1.45 KB 2023-07-15 13:22:43,371 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 13:22:43,649 INFO [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=242 B at sequenceid=28 (bloomFilter=true), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/.tmp/x/09e0ba377f354582a71e30759d40e004 2023-07-15 13:22:43,660 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/.tmp/x/09e0ba377f354582a71e30759d40e004 as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/09e0ba377f354582a71e30759d40e004 2023-07-15 13:22:43,668 INFO [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/09e0ba377f354582a71e30759d40e004, entries=10, sequenceid=28, filesize=5.0 K 2023-07-15 13:22:43,670 INFO [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~242 B/242, heapSize ~1.18 KB/1208, currentSize=0 B/0 for b9ba85199b5b1a9478e6ac08effc1eb3 in 436ms, sequenceid=28, compaction requested=false 2023-07-15 13:22:43,670 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b9ba85199b5b1a9478e6ac08effc1eb3: 2023-07-15 13:22:43,670 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:43,670 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-15 13:22:43,671 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-15 13:22:43,671 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,671 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table' locally acquired 2023-07-15 13:22:43,671 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39981,1689427345762' joining acquired barrier for procedure (hbase_shell_quota_tests_table) in zk 2023-07-15 13:22:43,673 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,673 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 13:22:43,673 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:43,673 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 13:22:43,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:43,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:43,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:43,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39981,1689427345762' joining acquired barrier for procedure 'hbase_shell_quota_tests_table' on coordinator 2023-07-15 13:22:43,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4abca681[Count = 0] remaining members to acquire global barrier 2023-07-15 13:22:43,676 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table' starting 'in-barrier' execution. 2023-07-15 13:22:43,676 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:43,678 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:43,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:43,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:43,679 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table' received 'reached' from coordinator. 2023-07-15 13:22:43,679 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table' locally completed 2023-07-15 13:22:43,679 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table' completed for member 'jenkins-hbase4.apache.org,39981,1689427345762' in zk 2023-07-15 13:22:43,679 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,679 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 13:22:43,681 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,681 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table' has notified controller of completion 2023-07-15 13:22:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 13:22:43,681 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 13:22:43,681 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table' completed. 2023-07-15 13:22:43,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:43,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:43,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:43,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:43,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:43,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table' member 'jenkins-hbase4.apache.org,39981,1689427345762': 2023-07-15 13:22:43,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39981,1689427345762' released barrier for procedure'hbase_shell_quota_tests_table', counting down latch. Waiting for 0 more 2023-07-15 13:22:43,685 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table' execution completed 2023-07-15 13:22:43,685 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 13:22:43,685 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 13:22:43,685 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table 2023-07-15 13:22:43,685 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_tableincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-15 13:22:43,687 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,687 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,687 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 13:22:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-15 13:22:43,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 13:22:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 13:22:43,688 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:43,689 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:43,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table 2023-07-15 13:22:43,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,692 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,692 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:43,692 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-15 13:22:43,692 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/hbase_shell_quota_tests_table 2023-07-15 13:22:43,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-15 13:22:43,692 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:43,692 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-15 13:22:43,692 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 13:22:43,692 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:43,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 13:22:43,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'hbase_shell_quota_tests_table' 2023-07-15 13:22:43,693 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/hbase_shell_quota_tests_table 2023-07-15 13:22:43,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-15 13:22:43,693 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/hbase_shell_quota_tests_table 2023-07-15 13:22:43,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/hbase_shell_quota_tests_table because node does not exist (not an error) 2023-07-15 13:22:43,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-15 13:22:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 13:22:43,694 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : hbase_shell_quota_tests_table'' to complete. (max 50000 ms per retry) 2023-07-15 13:22:43,695 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2698): (#1) Sleeping: 250ms while waiting for procedure completion. 2023-07-15 13:22:43,945 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-15 13:22:43,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done Took 0.7272 seconds 2023-07-15 13:22:43,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 13:22:43,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689427363949 (current time:1689427363949). 2023-07-15 13:22:43,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 13:22:43,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ReadOnlyZKClient(139): Connect 0x75b79cbf to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:43,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a5ba7bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:43,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:43,958 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:43,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75b79cbf to 127.0.0.1:64702 2023-07-15 13:22:43,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:43,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ReadOnlyZKClient(139): Connect 0x6b2a8c87 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:22:43,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2231a739, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:22:43,965 DEBUG [hconnection-0x7500aabb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:22:43,966 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:22:43,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b2a8c87 to 127.0.0.1:64702 2023-07-15 13:22:43,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:22:43,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] access.PermissionStorage(611): Read acl: entry[hbase_shell_quota_tests_table], kv [jenkins: RWXCA] 2023-07-15 13:22:43,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 13:22:43,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 13:22:43,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 13:22:43,975 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=23, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 13:22:43,976 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=23, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE; timeout=600000, timestamp=1689427963976 2023-07-15 13:22:43,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(653): Started snapshot: { ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } 2023-07-15 13:22:43,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table 2023-07-15 13:22:43,977 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }'' to complete. (max 50000 ms per retry) 2023-07-15 13:22:43,978 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=23, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE 2023-07-15 13:22:43,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 13:22:43,978 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2428): (#1) Sleeping: 250ms while waiting for snapshot completion. 2023-07-15 13:22:43,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=EXCLUSIVE in 5 msec 2023-07-15 13:22:43,979 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 13:22:43,980 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=24, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED; timeout=600000, timestamp=1689427963980 2023-07-15 13:22:44,228 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 13:22:44,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 13:22:44,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 13:22:44,230 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2428): (#2) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 13:22:44,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,392 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'hbase_shell_quota_tests_table_2' 2023-07-15 13:22:44,393 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 13:22:44,393 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'hbase_shell_quota_tests_table_2' starting 'acquire' 2023-07-15 13:22:44,393 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'hbase_shell_quota_tests_table_2', kicking off acquire phase on members. 2023-07-15 13:22:44,393 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,394 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,396 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,396 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 13:22:44,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 13:22:44,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 13:22:44,396 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,396 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 13:22:44,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 161 2023-07-15 13:22:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,397 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot hbase_shell_quota_tests_table_2 from table hbase_shell_quota_tests_table type FLUSH 2023-07-15 13:22:44,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,398 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'hbase_shell_quota_tests_table_2' with timeout 300000ms 2023-07-15 13:22:44,398 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 13:22:44,398 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'hbase_shell_quota_tests_table_2' starting 'acquire' stage 2023-07-15 13:22:44,398 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'hbase_shell_quota_tests_table_2' locally acquired 2023-07-15 13:22:44,398 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39981,1689427345762' joining acquired barrier for procedure (hbase_shell_quota_tests_table_2) in zk 2023-07-15 13:22:44,400 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,400 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 13:22:44,400 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,400 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'hbase_shell_quota_tests_table_2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 13:22:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:44,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:44,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:44,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39981,1689427345762' joining acquired barrier for procedure 'hbase_shell_quota_tests_table_2' on coordinator 2023-07-15 13:22:44,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1210858a[Count = 0] remaining members to acquire global barrier 2023-07-15 13:22:44,402 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'hbase_shell_quota_tests_table_2' starting 'in-barrier' execution. 2023-07-15 13:22:44,402 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,403 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'hbase_shell_quota_tests_table_2' received 'reached' from coordinator. 2023-07-15 13:22:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 13:22:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 13:22:44,404 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,404 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 13:22:44,404 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:44,404 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. started... 2023-07-15 13:22:44,405 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b9ba85199b5b1a9478e6ac08effc1eb3: 2023-07-15 13:22:44,405 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.' region-info for snapshot=hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,405 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 13:22:44,405 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/e1ebbfaf144941a9a085b3dab4bd8646, hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/09e0ba377f354582a71e30759d40e004] hfiles 2023-07-15 13:22:44,405 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/e1ebbfaf144941a9a085b3dab4bd8646 for snapshot=hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,405 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/x/09e0ba377f354582a71e30759d40e004 for snapshot=hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,405 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 13:22:44,731 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 13:22:44,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 13:22:44,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 13:22:44,734 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2428): (#3) Sleeping: 750ms while waiting for snapshot completion. 2023-07-15 13:22:44,819 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. completed. 2023-07-15 13:22:44,819 DEBUG [rs(jenkins-hbase4.apache.org,39981,1689427345762)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:22:44,819 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 13:22:44,819 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 13:22:44,819 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,819 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'hbase_shell_quota_tests_table_2' locally completed 2023-07-15 13:22:44,819 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'hbase_shell_quota_tests_table_2' completed for member 'jenkins-hbase4.apache.org,39981,1689427345762' in zk 2023-07-15 13:22:44,821 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'hbase_shell_quota_tests_table_2' has notified controller of completion 2023-07-15 13:22:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 13:22:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 13:22:44,822 DEBUG [member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'hbase_shell_quota_tests_table_2' completed. 2023-07-15 13:22:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'hbase_shell_quota_tests_table_2' member 'jenkins-hbase4.apache.org,39981,1689427345762': 2023-07-15 13:22:44,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39981,1689427345762' released barrier for procedure'hbase_shell_quota_tests_table_2', counting down latch. Waiting for 0 more 2023-07-15 13:22:44,826 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'hbase_shell_quota_tests_table_2' execution completed 2023-07-15 13:22:44,826 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 13:22:44,826 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 13:22:44,826 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,826 INFO [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure hbase_shell_quota_tests_table_2including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 13:22:44,829 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,829 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 13:22:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 13:22:44,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,829 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 13:22:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 13:22:44,829 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 13:22:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 13:22:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 13:22:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,831 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 13:22:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,833 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 13:22:44,833 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,834 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 13:22:44,834 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,834 DEBUG [(jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 13:22:44,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 13:22:44,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,834 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,835 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:22:44,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 13:22:44,835 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,835 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,835 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/hbase_shell_quota_tests_table_2 2023-07-15 13:22:44,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 13:22:44,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 13:22:44,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-15 13:22:45,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 to hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/hbase_shell_quota_tests_table_2 2023-07-15 13:22:45,484 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 13:22:45,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 13:22:45,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' is still in progress! 2023-07-15 13:22:45,486 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2428): (#4) Sleeping: 1250ms while waiting for snapshot completion. 2023-07-15 13:22:46,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed 2023-07-15 13:22:46,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-15 13:22:46,086 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/.hbase-snapshot/.tmp/hbase_shell_quota_tests_table_2 2023-07-15 13:22:46,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot hbase_shell_quota_tests_table_2 C_M_SNAPSHOT_TABLE on table hbase_shell_quota_tests_table at 1689427363976Consolidate snapshot: hbase_shell_quota_tests_table_2 at 1689427364835 (+859 ms)Loading Region manifests for hbase_shell_quota_tests_table_2 at 1689427364835Writing data manifest for hbase_shell_quota_tests_table_2 at 1689427364839 (+4 ms)Verifying snapshot: hbase_shell_quota_tests_table_2 at 1689427365250 (+411 ms)Snapshot hbase_shell_quota_tests_table_2 of table hbase_shell_quota_tests_table completed at 1689427366086 (+836 ms) 2023-07-15 13:22:46,088 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=24, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED 2023-07-15 13:22:46,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=hbase_shell_quota_tests_table, type=SHARED in 2.1110 sec 2023-07-15 13:22:46,737 DEBUG [Listener at localhost/36741] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 13:22:46,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 } is done 2023-07-15 13:22:46,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase_shell_quota_tests_table_2 table=hbase_shell_quota_tests_table type=FLUSH ttl=0 }' has completed, notifying client. Took 2.7929 seconds 2023-07-15 13:24:46,353 DEBUG [master/jenkins-hbase4:0.Chore.1] quotas.QuotaObserverChore(336): hbase_shell_quota_tests_table moved into observance of table space quota. 2023-07-15 13:27:25,780 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache(965): totalSize=587.81 KB, freeSize=781.83 MB, max=782.40 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2023-07-15 13:27:26,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): data stats (chunk size=2097152): current pool size=1, created chunk count=9, reused chunk count=1, reuseRatio=10.00% 2023-07-15 13:27:26,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(426): index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2023-07-15 13:27:27,797 INFO [jenkins-hbase4:39981Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(246): Global stats: WAL Edits Buffer Used=0B, Limit=268435456B 2023-07-15 13:27:29,761 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because 1588230740/info has an old edit so flush to free WALs after random delay 32226 ms 2023-07-15 13:27:29,852 DEBUG [master/jenkins-hbase4:0.Chore.1] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster. 2023-07-15 13:27:29,853 DEBUG [master/jenkins-hbase4:0.Chore.1] master.HMaster(1882): Balancer is going into sleep until next period in 300000ms 2023-07-15 13:27:29,859 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(200): Skipping table hbase_shell_quota_tests_table because normalization is disabled in its table properties and normalization is also disabled at table level by default 2023-07-15 13:27:29,865 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 13:27:30,762 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. because a5e454f1c63140dfb47323a41ba8198b/info has an old edit so flush to free WALs after random delay 265639 ms 2023-07-15 13:27:32,760 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. because c3bd5aeb70d48855e421f4d521b70117/f has an old edit so flush to free WALs after random delay 75935 ms 2023-07-15 13:27:33,766 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. because 8a8843ee9b899bc9176c5225b6bc7395/l has an old edit so flush to free WALs after random delay 275204 ms 2023-07-15 13:27:34,033 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-15 13:27:38,837 INFO [regionserver/jenkins-hbase4:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1918): MemstoreFlusherChore requesting flush of hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. because 1c9b5872368356a060b4893cf548cc0b/q has an old edit so flush to free WALs after random delay 169034 ms 2023-07-15 13:27:39,480 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:27:39,481 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2023-07-15 13:28:01,988 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(69): Since none of the CFs were above the size, flushing all. 2023-07-15 13:28:01,989 INFO [MemStoreFlusher.0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=6.34 KB heapSize=11.52 KB 2023-07-15 13:28:02,002 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.88 KB at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/.tmp/info/3986db4076944220a17bc3c769d59a79 2023-07-15 13:28:02,420 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=472 B at sequenceid=29 (bloomFilter=false), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/.tmp/table/c2c1a3aa36154a46a9c4984b87ec3822 2023-07-15 13:28:02,428 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/.tmp/info/3986db4076944220a17bc3c769d59a79 as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/info/3986db4076944220a17bc3c769d59a79 2023-07-15 13:28:02,434 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/info/3986db4076944220a17bc3c769d59a79, entries=50, sequenceid=29, filesize=10.6 K 2023-07-15 13:28:02,436 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/.tmp/table/c2c1a3aa36154a46a9c4984b87ec3822 as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/table/c2c1a3aa36154a46a9c4984b87ec3822 2023-07-15 13:28:02,442 INFO [MemStoreFlusher.0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/table/c2c1a3aa36154a46a9c4984b87ec3822, entries=10, sequenceid=29, filesize=5.1 K 2023-07-15 13:28:02,444 INFO [MemStoreFlusher.0] regionserver.HRegion(2948): Finished flush of dataSize ~6.34 KB/6489, heapSize ~11.23 KB/11504, currentSize=0 B/0 for 1588230740 in 455ms, sequenceid=29, compaction requested=false 2023-07-15 13:28:02,444 DEBUG [MemStoreFlusher.0] regionserver.HRegion(2446): Flush status journal for 1588230740: 2023-07-15 13:28:30,315 DEBUG [master/jenkins-hbase4:0.Chore.1] zookeeper.ReadOnlyZKClient(139): Connect 0x4279bb63 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:30,319 DEBUG [master/jenkins-hbase4:0.Chore.1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8181570, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:30,321 DEBUG [hconnection-0x3e5d00ef-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:30,322 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:28:32,059 INFO [Listener at localhost/36741] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:28:32,060 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bb8ce52 to 127.0.0.1:64702 2023-07-15 13:28:32,060 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,065 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x674aee5d to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,071 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ff00932, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,073 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,075 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:28:32,084 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x674aee5d to 127.0.0.1:64702 2023-07-15 13:28:32,084 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,089 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x3a7f1f2f to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,094 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e439d79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,096 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,098 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:28:32,104 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a7f1f2f to 127.0.0.1:64702 2023-07-15 13:28:32,104 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,105 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x7a456a1e to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,110 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d375de9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,113 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,114 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:28:32,119 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a456a1e to 127.0.0.1:64702 2023-07-15 13:28:32,119 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,121 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x758f0bc3 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,128 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bc608d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,130 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,132 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0104 seconds Took 0.0010 seconds Took 0.0009 seconds Took 0.0027 seconds Took 0.0018 seconds Took 0.0009 seconds Took 0.0008 seconds Took 0.0008 seconds Took 0.0007 seconds Took 0.0007 seconds Took 0.0007 seconds Took 0.0008 seconds 2023-07-15 13:28:32,176 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x758f0bc3 to 127.0.0.1:64702 2023-07-15 13:28:32,176 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,178 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x0b0a1ca1 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,183 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fa2b8e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,185 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,187 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0009 seconds 2023-07-15 13:28:32,194 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b0a1ca1 to 127.0.0.1:64702 2023-07-15 13:28:32,194 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,196 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x4e836ba5 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,200 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4aa4bb93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,202 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,204 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0009 seconds 2023-07-15 13:28:32,210 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e836ba5 to 127.0.0.1:64702 2023-07-15 13:28:32,210 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,214 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x4b79e766 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,217 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ac57749, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,219 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,221 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0010 seconds 2023-07-15 13:28:32,227 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b79e766 to 127.0.0.1:64702 2023-07-15 13:28:32,227 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,228 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x7edafa5a to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,232 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18b79807, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,234 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,236 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:28:32,241 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:28:32,243 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService Took 0.0069 seconds 2023-07-15 13:28:32,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from false to true 2023-07-15 13:28:32,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] quotas.MasterQuotaManager(451): Client=jenkins//172.31.14.131 switch exceed throttle quota from true to false Took 0.0032 seconds 2023-07-15 13:28:32,266 INFO [Listener at localhost/36741] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:28:32,266 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7edafa5a to 127.0.0.1:64702 2023-07-15 13:28:32,267 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,268 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x48708be3 to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,273 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58854c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,275 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,276 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 13:28:32,281 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 13:28:32,284 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 13:28:32,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] zookeeper.ZKUtil(398): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-15 13:28:32,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from true to false 2023-07-15 13:28:32,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] procedure2.ProcedureExecutor(1029): Stored pid=25, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,43297,1689427343904, rpcThrottleEnabled=false 2023-07-15 13:28:32,301 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:28:32,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,39981,1689427345762, rpcThrottleEnabled=false}] 2023-07-15 13:28:32,462 DEBUG [RSProcedureDispatcher-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 13:28:32,465 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 13:28:32,465 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39981] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=26 2023-07-15 13:28:32,467 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from true to false 2023-07-15 13:28:32,469 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=26 2023-07-15 13:28:32,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43297] master.HMaster(3641): Remote procedure done, pid=26 2023-07-15 13:28:32,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=25 2023-07-15 13:28:32,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=25, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,39981,1689427345762, rpcThrottleEnabled=false in 170 msec 2023-07-15 13:28:32,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,43297,1689427343904, rpcThrottleEnabled=false in 185 msec 2023-07-15 13:28:32,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] quotas.MasterQuotaManager(399): Client=jenkins//172.31.14.131 switch rpc throttle from false to true 2023-07-15 13:28:32,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43297] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:UPDATE_SWITCH_RPC_THROTTLE_STORAGE; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,43297,1689427343904, rpcThrottleEnabled=true 2023-07-15 13:28:32,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,39981,1689427345762, rpcThrottleEnabled=true}] 2023-07-15 13:28:32,636 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39981] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.replication.regionserver.SwitchRpcThrottleRemoteCallable, pid=28 2023-07-15 13:28:32,637 INFO [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] quotas.RegionServerRpcQuotaManager(95): Switch rpc throttle from false to true 2023-07-15 13:28:32,637 DEBUG [RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=28 2023-07-15 13:28:32,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43297] master.HMaster(3641): Remote procedure done, pid=28 2023-07-15 13:28:32,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 13:28:32,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; SwitchRpcThrottleRemoteProcedure server=jenkins-hbase4.apache.org,39981,1689427345762, rpcThrottleEnabled=true in 155 msec 2023-07-15 13:28:32,643 INFO [Listener at localhost/36741] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:28:32,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; SwitchRpcThrottleProcedure server=jenkins-hbase4.apache.org,43297,1689427343904, rpcThrottleEnabled=true in 162 msec 2023-07-15 13:28:32,644 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48708be3 to 127.0.0.1:64702 2023-07-15 13:28:32,644 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client .2023-07-15 13:28:32,646 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(139): Connect 0x66e103dc to 127.0.0.1:64702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 13:28:32,650 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60d7df80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-15 13:28:32,653 DEBUG [Listener at localhost/36741] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 13:28:32,655 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService Took 0.0011 seconds 2023-07-15 13:28:32,660 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66e103dc to 127.0.0.1:64702 2023-07-15 13:28:32,661 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client . Finished in 355.705759 seconds. ------------------------------------------------------------------------------- 16 tests, 62 assertions, 0 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications 100% passed ------------------------------------------------------------------------------- 0.04 tests/s, 0.17 assertions/s Done with tests! Shutting down the cluster... 2023-07-15 13:28:32,683 INFO [Listener at localhost/36741] hbase.ResourceChecker(175): after: client.TestQuotasShell#testRunShellTests Thread=268 (was 238) Potentially hanging thread: hconnection-0x64b4d5b3-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x66e103dc-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x3e5d00ef-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jnr.ffi.util.ref.internal.Finalizer java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) jnr.ffi.util.ref.internal.Finalizer.run(Finalizer.java:180) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4b79e766-SendThread(127.0.0.1:64702) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4b79e766-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4e836ba5-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x0b0a1ca1 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/682175820.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x48708be3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x0b0a1ca1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4279bb63-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4e836ba5-SendThread(127.0.0.1:64702) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x48708be3-SendThread(127.0.0.1:64702) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: (jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4279bb63-SendThread(127.0.0.1:64702) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x66e103dc java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/682175820.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43297,1689427343904)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e5d00ef-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Ruby-0-JIT-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_804022370_17 at /127.0.0.1:47084 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x64b4d5b3-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4279bb63 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/682175820.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4b79e766 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/682175820.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x64b4d5b3-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39981,1689427345762' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x48708be3 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/682175820.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x4e836ba5 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/682175820.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x64b4d5b3-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x66e103dc-SendThread(127.0.0.1:64702) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64702@0x0b0a1ca1-SendThread(127.0.0.1:64702) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) - Thread LEAK? -, OpenFileDescriptor=494 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=27 (was 270), ProcessCount=168 (was 173), AvailableMemoryMB=5520 (was 4978) - AvailableMemoryMB LEAK? - 2023-07-15 13:28:32,684 INFO [Listener at localhost/36741] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 13:28:32,684 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7aaf1408 to 127.0.0.1:64702 2023-07-15 13:28:32,684 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:28:32,685 DEBUG [Listener at localhost/36741] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 13:28:32,685 DEBUG [Listener at localhost/36741] util.JVMClusterUtil(257): Found active master hash=1304977257, stopped=false 2023-07-15 13:28:32,685 DEBUG [Listener at localhost/36741] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:32,685 DEBUG [Listener at localhost/36741] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 13:28:32,685 DEBUG [Listener at localhost/36741] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:28:32,685 DEBUG [Listener at localhost/36741] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-15 13:28:32,685 INFO [Listener at localhost/36741] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:28:32,687 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 13:28:32,687 INFO [Listener at localhost/36741] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 13:28:32,687 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 13:28:32,687 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:28:32,688 DEBUG [Listener at localhost/36741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e842350 to 127.0.0.1:64702 2023-07-15 13:28:32,688 DEBUG [Listener at localhost/36741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:28:32,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 13:28:32,688 INFO [Listener at localhost/36741] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39981,1689427345762' ***** 2023-07-15 13:28:32,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 13:28:32,688 DEBUG [Listener at localhost/36741] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:32,688 INFO [Listener at localhost/36741] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 13:28:32,689 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-15 13:28:32,697 INFO [RS:0;jenkins-hbase4:39981] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@22e8009a{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-15 13:28:32,701 INFO [RS:0;jenkins-hbase4:39981] server.AbstractConnector(383): Stopped ServerConnector@7d7b19c4{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-15 13:28:32,701 INFO [RS:0;jenkins-hbase4:39981] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-15 13:28:32,702 INFO [RS:0;jenkins-hbase4:39981] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@6e879f18{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-15 13:28:32,702 INFO [RS:0;jenkins-hbase4:39981] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@749cc6e1{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/hadoop.log.dir/,STOPPED} 2023-07-15 13:28:32,704 INFO [RS:0;jenkins-hbase4:39981] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 13:28:32,705 INFO [RS:0;jenkins-hbase4:39981] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 13:28:32,705 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 13:28:32,705 INFO [RS:0;jenkins-hbase4:39981] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 13:28:32,705 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(3305): Received CLOSE for 8a8843ee9b899bc9176c5225b6bc7395 2023-07-15 13:28:32,705 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(3305): Received CLOSE for c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:28:32,705 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(3305): Received CLOSE for 1c9b5872368356a060b4893cf548cc0b 2023-07-15 13:28:32,706 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(3305): Received CLOSE for a5e454f1c63140dfb47323a41ba8198b 2023-07-15 13:28:32,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a8843ee9b899bc9176c5225b6bc7395, disabling compactions & flushes 2023-07-15 13:28:32,706 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(3305): Received CLOSE for b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:28:32,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:28:32,706 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:28:32,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:28:32,706 INFO [RS:0;jenkins-hbase4:39981] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 13:28:32,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. after waiting 0 ms 2023-07-15 13:28:32,706 DEBUG [RS:0;jenkins-hbase4:39981] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05edec4f to 127.0.0.1:64702 2023-07-15 13:28:32,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:28:32,706 DEBUG [RS:0;jenkins-hbase4:39981] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:28:32,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8a8843ee9b899bc9176c5225b6bc7395 1/1 column families, dataSize=113 B heapSize=520 B 2023-07-15 13:28:32,706 INFO [RS:0;jenkins-hbase4:39981] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 13:28:32,707 INFO [RS:0;jenkins-hbase4:39981] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 13:28:32,707 INFO [RS:0;jenkins-hbase4:39981] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 13:28:32,707 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 13:28:32,707 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1474): Waiting on 6 regions to close 2023-07-15 13:28:32,707 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1478): Online Regions={8a8843ee9b899bc9176c5225b6bc7395=hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395., c3bd5aeb70d48855e421f4d521b70117=hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117., 1c9b5872368356a060b4893cf548cc0b=hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b., 1588230740=hbase:meta,,1.1588230740, a5e454f1c63140dfb47323a41ba8198b=hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b., b9ba85199b5b1a9478e6ac08effc1eb3=hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.} 2023-07-15 13:28:32,707 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 13:28:32,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 13:28:32,707 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 13:28:32,707 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 13:28:32,707 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 13:28:32,708 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1588230740, 1c9b5872368356a060b4893cf548cc0b, 8a8843ee9b899bc9176c5225b6bc7395, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3, c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:28:32,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/meta/1588230740/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-15 13:28:32,718 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:32,718 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 13:28:32,718 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:28:32,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 13:28:32,718 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 13:28:32,718 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 13:28:32,757 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 13:28:32,760 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 13:28:32,760 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 13:28:32,908 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1c9b5872368356a060b4893cf548cc0b, 8a8843ee9b899bc9176c5225b6bc7395, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3, c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:28:33,109 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1c9b5872368356a060b4893cf548cc0b, 8a8843ee9b899bc9176c5225b6bc7395, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3, c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:28:33,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=113 B at sequenceid=6 (bloomFilter=false), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395/.tmp/l/596baefadb6d4b299fef60a88498f054 2023-07-15 13:28:33,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395/.tmp/l/596baefadb6d4b299fef60a88498f054 as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395/l/596baefadb6d4b299fef60a88498f054 2023-07-15 13:28:33,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395/l/596baefadb6d4b299fef60a88498f054, entries=2, sequenceid=6, filesize=4.7 K 2023-07-15 13:28:33,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~113 B/113, heapSize ~504 B/504, currentSize=0 B/0 for 8a8843ee9b899bc9176c5225b6bc7395 in 435ms, sequenceid=6, compaction requested=false 2023-07-15 13:28:33,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/acl/8a8843ee9b899bc9176c5225b6bc7395/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 13:28:33,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:33,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:28:33,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:28:33,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a8843ee9b899bc9176c5225b6bc7395: 2023-07-15 13:28:33,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689427350331.8a8843ee9b899bc9176c5225b6bc7395. 2023-07-15 13:28:33,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3bd5aeb70d48855e421f4d521b70117, disabling compactions & flushes 2023-07-15 13:28:33,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:28:33,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:28:33,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. after waiting 0 ms 2023-07-15 13:28:33,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:28:33,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c3bd5aeb70d48855e421f4d521b70117 1/1 column families, dataSize=32 B heapSize=360 B 2023-07-15 13:28:33,309 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1c9b5872368356a060b4893cf548cc0b, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3, c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:28:33,509 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1c9b5872368356a060b4893cf548cc0b, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3, c3bd5aeb70d48855e421f4d521b70117 2023-07-15 13:28:33,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32 B at sequenceid=4 (bloomFilter=false), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117/.tmp/f/cefb481d8e5544f68c9a074f8bdfaace 2023-07-15 13:28:33,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117/.tmp/f/cefb481d8e5544f68c9a074f8bdfaace as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117/f/cefb481d8e5544f68c9a074f8bdfaace 2023-07-15 13:28:33,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117/f/cefb481d8e5544f68c9a074f8bdfaace, entries=1, sequenceid=4, filesize=4.6 K 2023-07-15 13:28:33,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32 B/32, heapSize ~344 B/344, currentSize=0 B/0 for c3bd5aeb70d48855e421f4d521b70117 in 427ms, sequenceid=4, compaction requested=false 2023-07-15 13:28:33,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/labels/c3bd5aeb70d48855e421f4d521b70117/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=1 2023-07-15 13:28:33,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:33,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:28:33,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:28:33,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3bd5aeb70d48855e421f4d521b70117: 2023-07-15 13:28:33,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:labels,,1689427351936.c3bd5aeb70d48855e421f4d521b70117. 2023-07-15 13:28:33,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c9b5872368356a060b4893cf548cc0b, disabling compactions & flushes 2023-07-15 13:28:33,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:28:33,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:28:33,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. after waiting 0 ms 2023-07-15 13:28:33,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:28:33,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1c9b5872368356a060b4893cf548cc0b 2/2 column families, dataSize=1.31 KB heapSize=3.84 KB 2023-07-15 13:28:33,709 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-15 13:28:33,710 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1478): Online Regions={1c9b5872368356a060b4893cf548cc0b=hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b., a5e454f1c63140dfb47323a41ba8198b=hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b., b9ba85199b5b1a9478e6ac08effc1eb3=hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.} 2023-07-15 13:28:33,710 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1c9b5872368356a060b4893cf548cc0b, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:28:33,910 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1c9b5872368356a060b4893cf548cc0b, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:28:33,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=830 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/.tmp/q/a7498c66e2054d659792c208897421f4 2023-07-15 13:28:34,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7498c66e2054d659792c208897421f4 2023-07-15 13:28:34,083 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:34,084 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 13:28:34,084 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:34,084 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 13:28:34,084 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-15 13:28:34,084 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:28:34,110 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1c9b5872368356a060b4893cf548cc0b, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:28:34,310 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on 1c9b5872368356a060b4893cf548cc0b, a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:28:34,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=510 B at sequenceid=24 (bloomFilter=true), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/.tmp/u/0c315b5498c542918baa00e26ecec48c 2023-07-15 13:28:34,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c315b5498c542918baa00e26ecec48c 2023-07-15 13:28:34,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/.tmp/q/a7498c66e2054d659792c208897421f4 as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/q/a7498c66e2054d659792c208897421f4 2023-07-15 13:28:34,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7498c66e2054d659792c208897421f4 2023-07-15 13:28:34,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/q/a7498c66e2054d659792c208897421f4, entries=8, sequenceid=24, filesize=5.2 K 2023-07-15 13:28:34,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/.tmp/u/0c315b5498c542918baa00e26ecec48c as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/u/0c315b5498c542918baa00e26ecec48c 2023-07-15 13:28:34,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c315b5498c542918baa00e26ecec48c 2023-07-15 13:28:34,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/u/0c315b5498c542918baa00e26ecec48c, entries=10, sequenceid=24, filesize=5.4 K 2023-07-15 13:28:34,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.31 KB/1340, heapSize ~3.80 KB/3896, currentSize=0 B/0 for 1c9b5872368356a060b4893cf548cc0b in 852ms, sequenceid=24, compaction requested=false 2023-07-15 13:28:34,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/quota/1c9b5872368356a060b4893cf548cc0b/recovered.edits/27.seqid, newMaxSeqId=27, maxSeqId=1 2023-07-15 13:28:34,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:34,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:28:34,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:28:34,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c9b5872368356a060b4893cf548cc0b: 2023-07-15 13:28:34,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1689427350278.1c9b5872368356a060b4893cf548cc0b. 2023-07-15 13:28:34,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a5e454f1c63140dfb47323a41ba8198b, disabling compactions & flushes 2023-07-15 13:28:34,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:28:34,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:28:34,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. after waiting 0 ms 2023-07-15 13:28:34,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:28:34,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a5e454f1c63140dfb47323a41ba8198b 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 13:28:34,511 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:28:34,711 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-15 13:28:34,711 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1478): Online Regions={a5e454f1c63140dfb47323a41ba8198b=hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b., b9ba85199b5b1a9478e6ac08effc1eb3=hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3.} 2023-07-15 13:28:34,711 DEBUG [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1504): Waiting on a5e454f1c63140dfb47323a41ba8198b, b9ba85199b5b1a9478e6ac08effc1eb3 2023-07-15 13:28:34,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b/.tmp/info/fbc3254921644fb0809003ee22396bde 2023-07-15 13:28:34,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b/.tmp/info/fbc3254921644fb0809003ee22396bde as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b/info/fbc3254921644fb0809003ee22396bde 2023-07-15 13:28:34,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b/info/fbc3254921644fb0809003ee22396bde, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 13:28:34,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a5e454f1c63140dfb47323a41ba8198b in 425ms, sequenceid=6, compaction requested=false 2023-07-15 13:28:34,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/hbase/namespace/a5e454f1c63140dfb47323a41ba8198b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 13:28:34,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:34,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:28:34,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:28:34,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a5e454f1c63140dfb47323a41ba8198b: 2023-07-15 13:28:34,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689427348749.a5e454f1c63140dfb47323a41ba8198b. 2023-07-15 13:28:34,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b9ba85199b5b1a9478e6ac08effc1eb3, disabling compactions & flushes 2023-07-15 13:28:34,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:28:34,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:28:34,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. after waiting 0 ms 2023-07-15 13:28:34,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:28:34,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/data/default/hbase_shell_quota_tests_table/b9ba85199b5b1a9478e6ac08effc1eb3/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-15 13:28:34,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 13:28:34,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2023-07-15 13:28:34,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:28:34,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b9ba85199b5b1a9478e6ac08effc1eb3: 2023-07-15 13:28:34,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase_shell_quota_tests_table,,1689427357047.b9ba85199b5b1a9478e6ac08effc1eb3. 2023-07-15 13:28:34,911 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39981,1689427345762; all regions closed. 2023-07-15 13:28:34,911 DEBUG [RS:0;jenkins-hbase4:39981] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-15 13:28:34,923 DEBUG [RS:0;jenkins-hbase4:39981] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/oldWALs 2023-07-15 13:28:34,923 INFO [RS:0;jenkins-hbase4:39981] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39981%2C1689427345762.meta:.meta(num 1689427348449) 2023-07-15 13:28:34,926 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/WALs/jenkins-hbase4.apache.org,39981,1689427345762/jenkins-hbase4.apache.org%2C39981%2C1689427345762.1689427347920 not finished, retry = 0 2023-07-15 13:28:35,030 DEBUG [RS:0;jenkins-hbase4:39981] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/oldWALs 2023-07-15 13:28:35,030 INFO [RS:0;jenkins-hbase4:39981] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39981%2C1689427345762:(num 1689427347920) 2023-07-15 13:28:35,030 DEBUG [RS:0;jenkins-hbase4:39981] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:28:35,030 INFO [RS:0;jenkins-hbase4:39981] regionserver.LeaseManager(133): Closed leases 2023-07-15 13:28:35,030 INFO [RS:0;jenkins-hbase4:39981] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 13:28:35,031 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 13:28:35,032 INFO [RS:0;jenkins-hbase4:39981] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39981 2023-07-15 13:28:35,040 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39981,1689427345762 2023-07-15 13:28:35,040 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 13:28:35,040 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 13:28:35,042 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39981,1689427345762] 2023-07-15 13:28:35,042 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39981,1689427345762; numProcessing=1 2023-07-15 13:28:35,043 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39981,1689427345762 already deleted, retry=false 2023-07-15 13:28:35,043 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39981,1689427345762 expired; onlineServers=0 2023-07-15 13:28:35,043 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43297,1689427343904' ***** 2023-07-15 13:28:35,043 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 13:28:35,044 DEBUG [M:0;jenkins-hbase4:43297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cf55552, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 13:28:35,044 INFO [M:0;jenkins-hbase4:43297] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-15 13:28:35,047 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 13:28:35,047 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 13:28:35,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 13:28:35,048 INFO [M:0;jenkins-hbase4:43297] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@20d608ca{master,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-15 13:28:35,049 INFO [M:0;jenkins-hbase4:43297] server.AbstractConnector(383): Stopped ServerConnector@203d2594{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-15 13:28:35,049 INFO [M:0;jenkins-hbase4:43297] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-15 13:28:35,049 INFO [M:0;jenkins-hbase4:43297] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@47d4f816{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-15 13:28:35,050 INFO [M:0;jenkins-hbase4:43297] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@5f5dbb14{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/hadoop.log.dir/,STOPPED} 2023-07-15 13:28:35,050 INFO [M:0;jenkins-hbase4:43297] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43297,1689427343904 2023-07-15 13:28:35,050 INFO [M:0;jenkins-hbase4:43297] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43297,1689427343904; all regions closed. 2023-07-15 13:28:35,050 DEBUG [M:0;jenkins-hbase4:43297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 13:28:35,050 INFO [M:0;jenkins-hbase4:43297] master.HMaster(1491): Stopping master jetty server 2023-07-15 13:28:35,051 INFO [M:0;jenkins-hbase4:43297] server.AbstractConnector(383): Stopped ServerConnector@7cd53d81{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-15 13:28:35,051 DEBUG [M:0;jenkins-hbase4:43297] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 13:28:35,051 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 13:28:35,051 DEBUG [M:0;jenkins-hbase4:43297] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 13:28:35,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689427347560] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689427347560,5,FailOnTimeoutGroup] 2023-07-15 13:28:35,052 INFO [M:0;jenkins-hbase4:43297] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 13:28:35,052 INFO [M:0;jenkins-hbase4:43297] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 13:28:35,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689427347561] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689427347561,5,FailOnTimeoutGroup] 2023-07-15 13:28:35,052 INFO [M:0;jenkins-hbase4:43297] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 13:28:35,052 DEBUG [M:0;jenkins-hbase4:43297] master.HMaster(1512): Stopping service threads 2023-07-15 13:28:35,052 INFO [M:0;jenkins-hbase4:43297] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 13:28:35,053 INFO [M:0;jenkins-hbase4:43297] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 13:28:35,053 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 13:28:35,053 DEBUG [M:0;jenkins-hbase4:43297] zookeeper.ZKUtil(398): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 13:28:35,053 WARN [M:0;jenkins-hbase4:43297] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 13:28:35,053 INFO [M:0;jenkins-hbase4:43297] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 13:28:35,054 INFO [M:0;jenkins-hbase4:43297] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 13:28:35,054 DEBUG [M:0;jenkins-hbase4:43297] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 13:28:35,054 INFO [M:0;jenkins-hbase4:43297] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 13:28:35,054 DEBUG [M:0;jenkins-hbase4:43297] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 13:28:35,054 DEBUG [M:0;jenkins-hbase4:43297] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 13:28:35,054 DEBUG [M:0;jenkins-hbase4:43297] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 13:28:35,054 INFO [M:0;jenkins-hbase4:43297] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=95.75 KB heapSize=115.68 KB 2023-07-15 13:28:35,067 INFO [M:0;jenkins-hbase4:43297] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=95.75 KB at sequenceid=237 (bloomFilter=true), to=hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/93e6231674f54d30872fd1466686b8e3 2023-07-15 13:28:35,072 INFO [M:0;jenkins-hbase4:43297] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93e6231674f54d30872fd1466686b8e3 2023-07-15 13:28:35,074 DEBUG [M:0;jenkins-hbase4:43297] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/93e6231674f54d30872fd1466686b8e3 as hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/93e6231674f54d30872fd1466686b8e3 2023-07-15 13:28:35,080 INFO [M:0;jenkins-hbase4:43297] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93e6231674f54d30872fd1466686b8e3 2023-07-15 13:28:35,081 INFO [M:0;jenkins-hbase4:43297] regionserver.HStore(1080): Added hdfs://localhost:36795/user/jenkins/test-data/7d95cf06-6c3c-b96e-c360-4a3d6ae10268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/93e6231674f54d30872fd1466686b8e3, entries=28, sequenceid=237, filesize=7.7 K 2023-07-15 13:28:35,082 INFO [M:0;jenkins-hbase4:43297] regionserver.HRegion(2948): Finished flush of dataSize ~95.75 KB/98050, heapSize ~115.66 KB/118440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=237, compaction requested=false 2023-07-15 13:28:35,083 INFO [M:0;jenkins-hbase4:43297] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 13:28:35,083 DEBUG [M:0;jenkins-hbase4:43297] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 13:28:35,086 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 13:28:35,086 INFO [M:0;jenkins-hbase4:43297] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 13:28:35,087 INFO [M:0;jenkins-hbase4:43297] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43297 2023-07-15 13:28:35,089 DEBUG [M:0;jenkins-hbase4:43297] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43297,1689427343904 already deleted, retry=false 2023-07-15 13:28:35,142 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 13:28:35,142 INFO [RS:0;jenkins-hbase4:39981] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39981,1689427345762; zookeeper connection closed. 2023-07-15 13:28:35,142 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): regionserver:39981-0x1016925f9a10001, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 13:28:35,143 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@52ea8bc7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@52ea8bc7 2023-07-15 13:28:35,143 INFO [Listener at localhost/36741] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-15 13:28:35,242 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 13:28:35,242 INFO [M:0;jenkins-hbase4:43297] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43297,1689427343904; zookeeper connection closed. 2023-07-15 13:28:35,243 DEBUG [Listener at localhost/36741-EventThread] zookeeper.ZKWatcher(600): master:43297-0x1016925f9a10000, quorum=127.0.0.1:64702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 13:28:35,244 WARN [Listener at localhost/36741] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 13:28:35,247 INFO [Listener at localhost/36741] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 13:28:35,352 WARN [BP-1790159988-172.31.14.131-1689427340812 heartbeating to localhost/127.0.0.1:36795] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 13:28:35,352 WARN [BP-1790159988-172.31.14.131-1689427340812 heartbeating to localhost/127.0.0.1:36795] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1790159988-172.31.14.131-1689427340812 (Datanode Uuid a1b9f9bb-5cdc-4b39-adb3-e10a731c6fee) service to localhost/127.0.0.1:36795 2023-07-15 13:28:35,354 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/cluster_11902d41-4ac4-9fd2-5a37-2f14ecb48e66/dfs/data/data1/current/BP-1790159988-172.31.14.131-1689427340812] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 13:28:35,354 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-shell/target/test-data/27014c6a-d392-ad86-15ec-a17201f387df/cluster_11902d41-4ac4-9fd2-5a37-2f14ecb48e66/dfs/data/data2/current/BP-1790159988-172.31.14.131-1689427340812] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 13:28:35,391 INFO [Listener at localhost/36741] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 13:28:35,503 INFO [Listener at localhost/36741] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 13:28:35,534 INFO [Listener at localhost/36741] hbase.HBaseTestingUtility(1293): Minicluster is down