2023-07-14 04:03:46,406 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415 2023-07-14 04:03:46,420 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestSnapshotWithAclAsyncAdmin timeout: 13 mins 2023-07-14 04:03:46,526 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 04:03:46,641 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 04:03:46,642 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/cluster_b593e329-f19a-8822-21e5-4d9c97e93cbb, deleteOnExit=true 2023-07-14 04:03:46,642 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 04:03:46,642 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/test.cache.data in system properties and HBase conf 2023-07-14 04:03:46,643 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 04:03:46,643 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/hadoop.log.dir in system properties and HBase conf 2023-07-14 04:03:46,644 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 04:03:46,644 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 04:03:46,644 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 04:03:46,927 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 04:03:46,931 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 04:03:46,931 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 04:03:46,931 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 04:03:46,932 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 04:03:46,932 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 04:03:46,932 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 04:03:46,932 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 04:03:46,933 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 04:03:46,933 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 04:03:46,933 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/nfs.dump.dir in system properties and HBase conf 2023-07-14 04:03:46,933 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/java.io.tmpdir in system properties and HBase conf 2023-07-14 04:03:46,934 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 04:03:46,934 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 04:03:46,934 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 04:03:47,394 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 04:03:47,398 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 04:03:47,679 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 04:03:47,842 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 04:03:47,856 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 04:03:47,891 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 04:03:47,923 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/java.io.tmpdir/Jetty_localhost_39061_hdfs____j87hbj/webapp 2023-07-14 04:03:48,087 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39061 2023-07-14 04:03:48,097 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 04:03:48,098 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 04:03:48,501 WARN [Listener at localhost/37843] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 04:03:48,571 WARN [Listener at localhost/37843] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 04:03:48,588 WARN [Listener at localhost/37843] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 04:03:48,594 INFO [Listener at localhost/37843] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 04:03:48,598 INFO [Listener at localhost/37843] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/java.io.tmpdir/Jetty_localhost_36083_datanode____pqvv3/webapp 2023-07-14 04:03:48,692 INFO [Listener at localhost/37843] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36083 2023-07-14 04:03:48,986 WARN [Listener at localhost/42791] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 04:03:49,414 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb4bf1b86af18962d: Processing first storage report for DS-ee125e3f-01e1-4182-93c5-40f027e88fdd from datanode b9309c1a-68c3-472c-aece-dda1be795ec4 2023-07-14 04:03:49,415 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb4bf1b86af18962d: from storage DS-ee125e3f-01e1-4182-93c5-40f027e88fdd node DatanodeRegistration(127.0.0.1:38861, datanodeUuid=b9309c1a-68c3-472c-aece-dda1be795ec4, infoPort=45909, infoSecurePort=0, ipcPort=42791, storageInfo=lv=-57;cid=testClusterID;nsid=487559523;c=1689307427473), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 04:03:49,416 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb4bf1b86af18962d: Processing first storage report for DS-a13cfb86-ed1f-4173-89dd-5dc4f1efe1c8 from datanode b9309c1a-68c3-472c-aece-dda1be795ec4 2023-07-14 04:03:49,416 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb4bf1b86af18962d: from storage DS-a13cfb86-ed1f-4173-89dd-5dc4f1efe1c8 node DatanodeRegistration(127.0.0.1:38861, datanodeUuid=b9309c1a-68c3-472c-aece-dda1be795ec4, infoPort=45909, infoSecurePort=0, ipcPort=42791, storageInfo=lv=-57;cid=testClusterID;nsid=487559523;c=1689307427473), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 04:03:49,477 DEBUG [Listener at localhost/42791] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415 2023-07-14 04:03:49,551 INFO [Listener at localhost/42791] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/cluster_b593e329-f19a-8822-21e5-4d9c97e93cbb/zookeeper_0, clientPort=50593, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/cluster_b593e329-f19a-8822-21e5-4d9c97e93cbb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/cluster_b593e329-f19a-8822-21e5-4d9c97e93cbb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 04:03:49,567 INFO [Listener at localhost/42791] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50593 2023-07-14 04:03:49,574 INFO [Listener at localhost/42791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 04:03:49,577 INFO [Listener at localhost/42791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 04:03:50,221 INFO [Listener at localhost/42791] util.FSUtils(471): Created version file at hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb with version=8 2023-07-14 04:03:50,222 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/hbase-staging 2023-07-14 04:03:50,517 INFO [Listener at localhost/42791] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 04:03:50,970 INFO [Listener at localhost/42791] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-14 04:03:51,002 INFO [Listener at localhost/42791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 04:03:51,002 INFO [Listener at localhost/42791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 04:03:51,002 INFO [Listener at localhost/42791] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 04:03:51,003 INFO [Listener at localhost/42791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 04:03:51,003 INFO [Listener at localhost/42791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 04:03:51,144 INFO [Listener at localhost/42791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 04:03:51,226 DEBUG [Listener at localhost/42791] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 04:03:51,319 INFO [Listener at localhost/42791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37381 2023-07-14 04:03:51,332 INFO [Listener at localhost/42791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 04:03:51,335 INFO [Listener at localhost/42791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 04:03:51,355 INFO [Listener at localhost/42791] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37381 connecting to ZooKeeper ensemble=127.0.0.1:50593 2023-07-14 04:03:51,393 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:373810x0, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 04:03:51,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37381-0x10162003da40000 connected 2023-07-14 04:03:51,417 DEBUG [Listener at localhost/42791] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 04:03:51,418 DEBUG [Listener at localhost/42791] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 04:03:51,431 DEBUG [Listener at localhost/42791] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 04:03:51,438 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37381 2023-07-14 04:03:51,438 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37381 2023-07-14 04:03:51,439 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37381 2023-07-14 04:03:51,439 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37381 2023-07-14 04:03:51,440 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37381 2023-07-14 04:03:51,445 INFO [Listener at localhost/42791] master.HMaster(444): hbase.rootdir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb, hbase.cluster.distributed=false 2023-07-14 04:03:51,508 INFO [Listener at localhost/42791] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-14 04:03:51,509 INFO [Listener at localhost/42791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 04:03:51,509 INFO [Listener at localhost/42791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 04:03:51,509 INFO [Listener at localhost/42791] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 04:03:51,509 INFO [Listener at localhost/42791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 04:03:51,509 INFO [Listener at localhost/42791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 04:03:51,514 INFO [Listener at localhost/42791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 04:03:51,517 INFO [Listener at localhost/42791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41323 2023-07-14 04:03:51,519 INFO [Listener at localhost/42791] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 04:03:51,526 DEBUG [Listener at localhost/42791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 04:03:51,527 INFO [Listener at localhost/42791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 04:03:51,530 INFO [Listener at localhost/42791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 04:03:51,532 INFO [Listener at localhost/42791] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41323 connecting to ZooKeeper ensemble=127.0.0.1:50593 2023-07-14 04:03:51,536 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:413230x0, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 04:03:51,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41323-0x10162003da40001 connected 2023-07-14 04:03:51,537 DEBUG [Listener at localhost/42791] zookeeper.ZKUtil(164): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 04:03:51,538 DEBUG [Listener at localhost/42791] zookeeper.ZKUtil(164): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 04:03:51,539 DEBUG [Listener at localhost/42791] zookeeper.ZKUtil(164): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 04:03:51,539 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41323 2023-07-14 04:03:51,540 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41323 2023-07-14 04:03:51,540 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41323 2023-07-14 04:03:51,541 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41323 2023-07-14 04:03:51,541 DEBUG [Listener at localhost/42791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41323 2023-07-14 04:03:51,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:03:51,551 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 04:03:51,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:03:51,572 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 04:03:51,572 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 04:03:51,572 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:51,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 04:03:51,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37381,1689307430362 from backup master directory 2023-07-14 04:03:51,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 04:03:51,578 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:03:51,578 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 04:03:51,578 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 04:03:51,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:03:51,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 04:03:51,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 04:03:51,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/hbase.id with ID: 9cd22094-b3e8-46bb-bff1-173cbf1e3c30 2023-07-14 04:03:51,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 04:03:51,718 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:51,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x714123e5 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:51,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@177ca70b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:51,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 04:03:51,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 04:03:51,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 04:03:51,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 04:03:51,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 04:03:51,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 04:03:51,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 04:03:51,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store-tmp 2023-07-14 04:03:52,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:52,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 04:03:52,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 04:03:52,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 04:03:52,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 04:03:52,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 04:03:52,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 04:03:52,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 04:03:52,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/WALs/jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:03:52,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37381%2C1689307430362, suffix=, logDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/WALs/jenkins-hbase4.apache.org,37381,1689307430362, archiveDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/oldWALs, maxLogs=10 2023-07-14 04:03:52,369 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38861,DS-ee125e3f-01e1-4182-93c5-40f027e88fdd,DISK] 2023-07-14 04:03:52,376 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 04:03:52,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/WALs/jenkins-hbase4.apache.org,37381,1689307430362/jenkins-hbase4.apache.org%2C37381%2C1689307430362.1689307432327 2023-07-14 04:03:52,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38861,DS-ee125e3f-01e1-4182-93c5-40f027e88fdd,DISK]] 2023-07-14 04:03:52,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 04:03:52,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:52,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 04:03:52,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 04:03:52,495 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 04:03:52,502 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 04:03:52,527 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 04:03:52,540 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:52,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 04:03:52,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 04:03:52,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 04:03:52,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:03:52,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69504865, jitterRate=0.03570319712162018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:03:52,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 04:03:52,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 04:03:52,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 04:03:52,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 04:03:52,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 04:03:52,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-14 04:03:52,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 30 msec 2023-07-14 04:03:52,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 04:03:52,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 04:03:52,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 04:03:52,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 04:03:52,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 04:03:52,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 04:03:52,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 04:03:52,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 04:03:52,694 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:52,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 04:03:52,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 04:03:52,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 04:03:52,713 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 04:03:52,713 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 04:03:52,713 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:52,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37381,1689307430362, sessionid=0x10162003da40000, setting cluster-up flag (Was=false) 2023-07-14 04:03:52,731 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:52,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 04:03:52,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:03:52,742 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:52,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 04:03:52,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:03:52,752 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp 2023-07-14 04:03:52,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 04:03:52,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:03:52,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 04:03:52,845 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(951): ClusterId : 9cd22094-b3e8-46bb-bff1-173cbf1e3c30 2023-07-14 04:03:52,850 DEBUG [RS:0;jenkins-hbase4:41323] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 04:03:52,855 DEBUG [RS:0;jenkins-hbase4:41323] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 04:03:52,855 DEBUG [RS:0;jenkins-hbase4:41323] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 04:03:52,858 DEBUG [RS:0;jenkins-hbase4:41323] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 04:03:52,858 DEBUG [RS:0;jenkins-hbase4:41323] zookeeper.ReadOnlyZKClient(139): Connect 0x18392234 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:52,863 DEBUG [RS:0;jenkins-hbase4:41323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16fedf43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:52,864 DEBUG [RS:0;jenkins-hbase4:41323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12c14944, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-14 04:03:52,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 04:03:52,893 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41323 2023-07-14 04:03:52,897 INFO [RS:0;jenkins-hbase4:41323] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 04:03:52,897 INFO [RS:0;jenkins-hbase4:41323] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 04:03:52,897 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 04:03:52,898 INFO [RS:0;jenkins-hbase4:41323] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:03:52,898 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 04:03:52,901 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37381,1689307430362 with isa=jenkins-hbase4.apache.org/172.31.14.131:41323, startcode=1689307431507 2023-07-14 04:03:52,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-14 04:03:52,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-14 04:03:52,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-14 04:03:52,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-14 04:03:52,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-14 04:03:52,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:52,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-14 04:03:52,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:52,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689307462905 2023-07-14 04:03:52,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 04:03:52,911 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 04:03:52,911 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 04:03:52,916 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 04:03:52,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 04:03:52,917 DEBUG [RS:0;jenkins-hbase4:41323] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 04:03:52,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 04:03:52,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 04:03:52,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 04:03:52,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 04:03:52,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:52,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 04:03:52,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 04:03:52,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 04:03:52,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 04:03:52,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 04:03:52,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689307432933,5,FailOnTimeoutGroup] 2023-07-14 04:03:52,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689307432934,5,FailOnTimeoutGroup] 2023-07-14 04:03:52,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:52,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 04:03:52,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:52,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:52,967 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42239, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 04:03:52,977 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37381] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:52,991 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb 2023-07-14 04:03:52,991 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37843 2023-07-14 04:03:52,991 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 04:03:52,996 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 04:03:52,997 DEBUG [RS:0;jenkins-hbase4:41323] zookeeper.ZKUtil(162): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:52,997 WARN [RS:0;jenkins-hbase4:41323] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 04:03:52,997 INFO [RS:0;jenkins-hbase4:41323] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 04:03:52,998 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/WALs/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:52,999 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41323,1689307431507] 2023-07-14 04:03:53,006 DEBUG [RS:0;jenkins-hbase4:41323] zookeeper.ZKUtil(162): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:53,015 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 04:03:53,023 INFO [RS:0;jenkins-hbase4:41323] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 04:03:53,043 INFO [RS:0;jenkins-hbase4:41323] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 04:03:53,049 INFO [RS:0;jenkins-hbase4:41323] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 04:03:53,049 INFO [RS:0;jenkins-hbase4:41323] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:53,050 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 04:03:53,058 INFO [RS:0;jenkins-hbase4:41323] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:53,058 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,059 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,059 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,059 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,059 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,059 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-14 04:03:53,059 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,059 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,059 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,060 DEBUG [RS:0;jenkins-hbase4:41323] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-14 04:03:53,060 INFO [RS:0;jenkins-hbase4:41323] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:53,060 INFO [RS:0;jenkins-hbase4:41323] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:53,061 INFO [RS:0;jenkins-hbase4:41323] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:53,076 INFO [RS:0;jenkins-hbase4:41323] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 04:03:53,078 INFO [RS:0;jenkins-hbase4:41323] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41323,1689307431507-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:53,093 INFO [RS:0;jenkins-hbase4:41323] regionserver.Replication(203): jenkins-hbase4.apache.org,41323,1689307431507 started 2023-07-14 04:03:53,093 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41323,1689307431507, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41323, sessionid=0x10162003da40001 2023-07-14 04:03:53,093 DEBUG [RS:0;jenkins-hbase4:41323] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 04:03:53,093 DEBUG [RS:0;jenkins-hbase4:41323] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:53,094 DEBUG [RS:0;jenkins-hbase4:41323] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41323,1689307431507' 2023-07-14 04:03:53,094 DEBUG [RS:0;jenkins-hbase4:41323] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 04:03:53,094 DEBUG [RS:0;jenkins-hbase4:41323] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 04:03:53,095 DEBUG [RS:0;jenkins-hbase4:41323] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 04:03:53,095 DEBUG [RS:0;jenkins-hbase4:41323] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 04:03:53,095 DEBUG [RS:0;jenkins-hbase4:41323] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:53,095 DEBUG [RS:0;jenkins-hbase4:41323] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41323,1689307431507' 2023-07-14 04:03:53,095 DEBUG [RS:0;jenkins-hbase4:41323] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 04:03:53,095 DEBUG [RS:0;jenkins-hbase4:41323] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 04:03:53,096 DEBUG [RS:0;jenkins-hbase4:41323] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 04:03:53,096 INFO [RS:0;jenkins-hbase4:41323] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 04:03:53,096 INFO [RS:0;jenkins-hbase4:41323] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 04:03:53,207 INFO [RS:0;jenkins-hbase4:41323] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41323%2C1689307431507, suffix=, logDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/WALs/jenkins-hbase4.apache.org,41323,1689307431507, archiveDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/oldWALs, maxLogs=32 2023-07-14 04:03:53,225 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38861,DS-ee125e3f-01e1-4182-93c5-40f027e88fdd,DISK] 2023-07-14 04:03:53,228 INFO [RS:0;jenkins-hbase4:41323] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/WALs/jenkins-hbase4.apache.org,41323,1689307431507/jenkins-hbase4.apache.org%2C41323%2C1689307431507.1689307433209 2023-07-14 04:03:53,229 DEBUG [RS:0;jenkins-hbase4:41323] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38861,DS-ee125e3f-01e1-4182-93c5-40f027e88fdd,DISK]] 2023-07-14 04:03:53,352 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 04:03:53,353 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 04:03:53,353 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb 2023-07-14 04:03:53,766 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:53,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 04:03:53,771 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/info 2023-07-14 04:03:53,771 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 04:03:53,772 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:53,773 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 04:03:53,775 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/rep_barrier 2023-07-14 04:03:53,776 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 04:03:53,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:53,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 04:03:53,778 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/table 2023-07-14 04:03:53,779 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 04:03:53,780 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:53,781 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740 2023-07-14 04:03:53,782 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740 2023-07-14 04:03:53,786 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 04:03:53,788 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 04:03:53,791 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:03:53,792 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66134912, jitterRate=-0.014513015747070312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 04:03:53,792 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 04:03:53,792 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 04:03:53,793 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 04:03:53,793 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 04:03:53,793 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 04:03:53,793 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 04:03:53,793 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 04:03:53,794 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 04:03:53,798 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 04:03:53,798 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 04:03:53,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 04:03:53,817 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 04:03:53,819 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 04:03:53,971 DEBUG [jenkins-hbase4:37381] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-14 04:03:53,974 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41323,1689307431507, state=OPENING 2023-07-14 04:03:53,982 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 04:03:53,984 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:53,985 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 04:03:53,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:03:54,172 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:54,175 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 04:03:54,178 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 04:03:54,190 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 04:03:54,190 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 04:03:54,193 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41323%2C1689307431507.meta, suffix=.meta, logDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/WALs/jenkins-hbase4.apache.org,41323,1689307431507, archiveDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/oldWALs, maxLogs=32 2023-07-14 04:03:54,209 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38861,DS-ee125e3f-01e1-4182-93c5-40f027e88fdd,DISK] 2023-07-14 04:03:54,213 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/WALs/jenkins-hbase4.apache.org,41323,1689307431507/jenkins-hbase4.apache.org%2C41323%2C1689307431507.meta.1689307434195.meta 2023-07-14 04:03:54,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38861,DS-ee125e3f-01e1-4182-93c5-40f027e88fdd,DISK]] 2023-07-14 04:03:54,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 04:03:54,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 04:03:54,217 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:03:54,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 04:03:54,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 04:03:54,221 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 04:03:54,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 04:03:54,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:54,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 04:03:54,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 04:03:54,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 04:03:54,237 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/info 2023-07-14 04:03:54,237 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/info 2023-07-14 04:03:54,238 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 04:03:54,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:54,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 04:03:54,240 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/rep_barrier 2023-07-14 04:03:54,240 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/rep_barrier 2023-07-14 04:03:54,241 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 04:03:54,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:54,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 04:03:54,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/table 2023-07-14 04:03:54,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/table 2023-07-14 04:03:54,244 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 04:03:54,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:54,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740 2023-07-14 04:03:54,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740 2023-07-14 04:03:54,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 04:03:54,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 04:03:54,256 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64967716, jitterRate=-0.03190559148788452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 04:03:54,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 04:03:54,267 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689307434163 2023-07-14 04:03:54,283 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 04:03:54,285 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 04:03:54,286 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41323,1689307431507, state=OPEN 2023-07-14 04:03:54,289 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 04:03:54,289 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 04:03:54,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 04:03:54,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41323,1689307431507 in 301 msec 2023-07-14 04:03:54,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 04:03:54,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 488 msec 2023-07-14 04:03:54,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4800 sec 2023-07-14 04:03:54,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689307434302, completionTime=-1 2023-07-14 04:03:54,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-14 04:03:54,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 04:03:54,365 DEBUG [hconnection-0x12bb43db-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:54,369 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:03:54,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-14 04:03:54,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689307494389 2023-07-14 04:03:54,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689307554389 2023-07-14 04:03:54,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 86 msec 2023-07-14 04:03:54,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37381,1689307430362-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:54,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37381,1689307430362-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:54,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37381,1689307430362-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:54,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37381, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:54,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 04:03:54,422 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 04:03:54,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 04:03:54,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 04:03:54,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 04:03:54,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 04:03:54,453 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 04:03:54,476 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/hbase/namespace/475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:54,478 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/hbase/namespace/475da83a3b04248fcc83155226158a0c empty. 2023-07-14 04:03:54,479 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/hbase/namespace/475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:54,479 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 04:03:54,903 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 04:03:54,907 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 475da83a3b04248fcc83155226158a0c, NAME => 'hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:03:55,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:55,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 475da83a3b04248fcc83155226158a0c, disabling compactions & flushes 2023-07-14 04:03:55,320 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:03:55,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:03:55,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. after waiting 0 ms 2023-07-14 04:03:55,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:03:55,320 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:03:55,320 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 475da83a3b04248fcc83155226158a0c: 2023-07-14 04:03:55,325 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 04:03:55,340 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689307435328"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307435328"}]},"ts":"1689307435328"} 2023-07-14 04:03:55,367 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 04:03:55,369 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 04:03:55,374 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307435370"}]},"ts":"1689307435370"} 2023-07-14 04:03:55,378 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 04:03:55,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=475da83a3b04248fcc83155226158a0c, ASSIGN}] 2023-07-14 04:03:55,388 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=475da83a3b04248fcc83155226158a0c, ASSIGN 2023-07-14 04:03:55,390 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=475da83a3b04248fcc83155226158a0c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:03:55,541 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=475da83a3b04248fcc83155226158a0c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:55,541 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689307435540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307435540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307435540"}]},"ts":"1689307435540"} 2023-07-14 04:03:55,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 475da83a3b04248fcc83155226158a0c, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:03:55,705 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:03:55,705 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 475da83a3b04248fcc83155226158a0c, NAME => 'hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c.', STARTKEY => '', ENDKEY => ''} 2023-07-14 04:03:55,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. service=AccessControlService 2023-07-14 04:03:55,707 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:03:55,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:55,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:55,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:55,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:55,709 INFO [StoreOpener-475da83a3b04248fcc83155226158a0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:55,712 DEBUG [StoreOpener-475da83a3b04248fcc83155226158a0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c/info 2023-07-14 04:03:55,712 DEBUG [StoreOpener-475da83a3b04248fcc83155226158a0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c/info 2023-07-14 04:03:55,712 INFO [StoreOpener-475da83a3b04248fcc83155226158a0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 475da83a3b04248fcc83155226158a0c columnFamilyName info 2023-07-14 04:03:55,713 INFO [StoreOpener-475da83a3b04248fcc83155226158a0c-1] regionserver.HStore(310): Store=475da83a3b04248fcc83155226158a0c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:55,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:55,715 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:55,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 475da83a3b04248fcc83155226158a0c 2023-07-14 04:03:55,724 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:03:55,724 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 475da83a3b04248fcc83155226158a0c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74093219, jitterRate=0.10407499969005585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:03:55,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 475da83a3b04248fcc83155226158a0c: 2023-07-14 04:03:55,726 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c., pid=6, masterSystemTime=1689307435699 2023-07-14 04:03:55,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:03:55,731 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:03:55,732 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=475da83a3b04248fcc83155226158a0c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:55,733 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689307435731"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307435731"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307435731"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307435731"}]},"ts":"1689307435731"} 2023-07-14 04:03:55,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 04:03:55,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 475da83a3b04248fcc83155226158a0c, server=jenkins-hbase4.apache.org,41323,1689307431507 in 191 msec 2023-07-14 04:03:55,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 04:03:55,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=475da83a3b04248fcc83155226158a0c, ASSIGN in 354 msec 2023-07-14 04:03:55,744 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 04:03:55,745 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307435745"}]},"ts":"1689307435745"} 2023-07-14 04:03:55,747 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 04:03:55,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 04:03:55,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 04:03:55,754 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 04:03:55,754 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:55,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3170 sec 2023-07-14 04:03:55,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 04:03:55,801 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 04:03:55,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 25 msec 2023-07-14 04:03:55,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 04:03:55,822 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 04:03:55,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-14 04:03:55,836 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 04:03:55,839 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 04:03:55,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.262sec 2023-07-14 04:03:55,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 04:03:55,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 04:03:55,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 04:03:55,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37381,1689307430362-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 04:03:55,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37381,1689307430362-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 04:03:55,851 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x344cf7e4 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:55,856 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d69c669, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:55,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 04:03:55,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 04:03:55,870 DEBUG [hconnection-0x5d1e8a3e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:55,871 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 04:03:55,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 04:03:55,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 04:03:55,876 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/hbase/acl/32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:55,877 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/hbase/acl/32a655f65cbf98a730e437788b0a521a empty. 2023-07-14 04:03:55,879 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/hbase/acl/32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:55,879 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 04:03:55,883 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:03:55,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 04:03:55,885 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:03:55,886 DEBUG [Listener at localhost/42791] hbase.HBaseTestingUtility(3430): Waiting until all regions of table hbase:acl get assigned. Timeout = 60000ms 2023-07-14 04:03:55,887 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:03:55,898 WARN [Listener at localhost/42791] hbase.HBaseTestingUtility$4(3476): Didn't find the entries for table hbase:acl in meta, already deleted? 2023-07-14 04:03:55,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 04:03:56,102 WARN [Listener at localhost/42791] hbase.HBaseTestingUtility$4(3476): Didn't find the entries for table hbase:acl in meta, already deleted? 2023-07-14 04:03:56,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 04:03:56,302 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 04:03:56,304 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 32a655f65cbf98a730e437788b0a521a, NAME => 'hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:03:56,306 WARN [Listener at localhost/42791] hbase.HBaseTestingUtility$4(3476): Didn't find the entries for table hbase:acl in meta, already deleted? 2023-07-14 04:03:56,316 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:56,316 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 32a655f65cbf98a730e437788b0a521a, disabling compactions & flushes 2023-07-14 04:03:56,316 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:03:56,316 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:03:56,316 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. after waiting 0 ms 2023-07-14 04:03:56,316 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:03:56,316 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:03:56,316 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 32a655f65cbf98a730e437788b0a521a: 2023-07-14 04:03:56,321 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 04:03:56,322 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689307436322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307436322"}]},"ts":"1689307436322"} 2023-07-14 04:03:56,325 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 04:03:56,327 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 04:03:56,327 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307436327"}]},"ts":"1689307436327"} 2023-07-14 04:03:56,329 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 04:03:56,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=32a655f65cbf98a730e437788b0a521a, ASSIGN}] 2023-07-14 04:03:56,335 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=32a655f65cbf98a730e437788b0a521a, ASSIGN 2023-07-14 04:03:56,336 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=32a655f65cbf98a730e437788b0a521a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:03:56,487 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=32a655f65cbf98a730e437788b0a521a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:56,488 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689307436487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307436487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307436487"}]},"ts":"1689307436487"} 2023-07-14 04:03:56,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 04:03:56,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 32a655f65cbf98a730e437788b0a521a, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:03:56,650 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:03:56,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 32a655f65cbf98a730e437788b0a521a, NAME => 'hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a.', STARTKEY => '', ENDKEY => ''} 2023-07-14 04:03:56,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. service=AccessControlService 2023-07-14 04:03:56,651 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:03:56,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:56,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:56,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:56,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:56,653 INFO [StoreOpener-32a655f65cbf98a730e437788b0a521a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:56,655 DEBUG [StoreOpener-32a655f65cbf98a730e437788b0a521a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a/l 2023-07-14 04:03:56,656 DEBUG [StoreOpener-32a655f65cbf98a730e437788b0a521a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a/l 2023-07-14 04:03:56,656 INFO [StoreOpener-32a655f65cbf98a730e437788b0a521a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32a655f65cbf98a730e437788b0a521a columnFamilyName l 2023-07-14 04:03:56,657 INFO [StoreOpener-32a655f65cbf98a730e437788b0a521a-1] regionserver.HStore(310): Store=32a655f65cbf98a730e437788b0a521a/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:56,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:56,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:56,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 32a655f65cbf98a730e437788b0a521a 2023-07-14 04:03:56,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:03:56,668 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 32a655f65cbf98a730e437788b0a521a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65848966, jitterRate=-0.018773943185806274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:03:56,668 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 32a655f65cbf98a730e437788b0a521a: 2023-07-14 04:03:56,669 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a., pid=11, masterSystemTime=1689307436645 2023-07-14 04:03:56,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:03:56,672 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:03:56,673 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=32a655f65cbf98a730e437788b0a521a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:56,674 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689307436673"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307436673"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307436673"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307436673"}]},"ts":"1689307436673"} 2023-07-14 04:03:56,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 04:03:56,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 32a655f65cbf98a730e437788b0a521a, server=jenkins-hbase4.apache.org,41323,1689307431507 in 185 msec 2023-07-14 04:03:56,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 04:03:56,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=32a655f65cbf98a730e437788b0a521a, ASSIGN in 346 msec 2023-07-14 04:03:56,683 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 04:03:56,683 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307436683"}]},"ts":"1689307436683"} 2023-07-14 04:03:56,686 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 04:03:56,690 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 04:03:56,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 822 msec 2023-07-14 04:03:56,714 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(3484): All regions for table hbase:acl assigned to meta. Checking AM states. 2023-07-14 04:03:56,715 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:03:56,715 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(3504): All regions for table hbase:acl assigned. 2023-07-14 04:03:56,715 ERROR [Listener at localhost/42791] master.HMaster(2923): Coprocessor service AccessControlService already registered, rejecting request from org.apache.hadoop.hbase.protobuf.generated.AccessControlProtos$AccessControlService$1@293fbd49 2023-07-14 04:03:56,736 INFO [Listener at localhost/42791] hbase.ResourceChecker(147): before: client.TestSnapshotWithAclAsyncAdmin#testRestoreSnapshot Thread=215, OpenFileDescriptor=473, MaxFileDescriptor=60000, SystemLoadAverage=48, ProcessCount=170, AvailableMemoryMB=6837 2023-07-14 04:03:56,745 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:03:56,748 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:03:56,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'fb8fce90-ed2c-98d2-b8ee-9608d264d688', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 04:03:56,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:03:56,757 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 04:03:56,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" procId is: 12 2023-07-14 04:03:56,760 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 04:03:56,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 04:03:56,763 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:56,763 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:56,764 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 empty. 2023-07-14 04:03:56,764 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed empty. 2023-07-14 04:03:56,765 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:56,765 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:56,765 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived fb8fce90-ed2c-98d2-b8ee-9608d264d688 regions 2023-07-14 04:03:56,780 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/.tabledesc/.tableinfo.0000000001 2023-07-14 04:03:56,783 INFO [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(7675): creating {ENCODED => ed1e85127c4d73d8edec872fdc80d2ed, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.', STARTKEY => 's', ENDKEY => ''}, tableDescriptor='fb8fce90-ed2c-98d2-b8ee-9608d264d688', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:03:56,783 INFO [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c4e06fb4ecdd3c332880d64437f3855, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.', STARTKEY => '', ENDKEY => 's'}, tableDescriptor='fb8fce90-ed2c-98d2-b8ee-9608d264d688', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:03:56,797 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(866): Instantiated fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:56,798 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(1604): Closing ed1e85127c4d73d8edec872fdc80d2ed, disabling compactions & flushes 2023-07-14 04:03:56,798 INFO [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(1626): Closing region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:03:56,798 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:03:56,798 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(866): Instantiated fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:56,798 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(1714): Acquired close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. after waiting 0 ms 2023-07-14 04:03:56,798 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(1604): Closing 1c4e06fb4ecdd3c332880d64437f3855, disabling compactions & flushes 2023-07-14 04:03:56,798 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(1724): Updates disabled for region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:03:56,798 INFO [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(1626): Closing region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:03:56,798 INFO [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(1838): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:03:56,799 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:03:56,799 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-1] regionserver.HRegion(1558): Region close journal for ed1e85127c4d73d8edec872fdc80d2ed: 2023-07-14 04:03:56,799 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(1714): Acquired close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. after waiting 0 ms 2023-07-14 04:03:56,799 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(1724): Updates disabled for region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:03:56,799 INFO [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(1838): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:03:56,799 DEBUG [RegionOpenAndInit-fb8fce90-ed2c-98d2-b8ee-9608d264d688-pool-0] regionserver.HRegion(1558): Region close journal for 1c4e06fb4ecdd3c332880d64437f3855: 2023-07-14 04:03:56,803 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 04:03:56,804 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307436804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307436804"}]},"ts":"1689307436804"} 2023-07-14 04:03:56,804 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307436804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307436804"}]},"ts":"1689307436804"} 2023-07-14 04:03:56,849 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 04:03:56,851 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 04:03:56,851 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307436851"}]},"ts":"1689307436851"} 2023-07-14 04:03:56,853 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=ENABLING in hbase:meta 2023-07-14 04:03:56,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN}] 2023-07-14 04:03:56,859 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN 2023-07-14 04:03:56,859 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN 2023-07-14 04:03:56,861 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:03:56,861 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:03:56,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 04:03:56,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 04:03:56,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 04:03:56,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 04:03:57,012 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:57,012 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:57,012 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307437012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307437012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307437012"}]},"ts":"1689307437012"} 2023-07-14 04:03:57,012 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307437012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307437012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307437012"}]},"ts":"1689307437012"} 2023-07-14 04:03:57,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:03:57,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:03:57,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 04:03:57,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:03:57,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c4e06fb4ecdd3c332880d64437f3855, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.', STARTKEY => '', ENDKEY => 's'} 2023-07-14 04:03:57,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. service=AccessControlService 2023-07-14 04:03:57,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:03:57,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table fb8fce90-ed2c-98d2-b8ee-9608d264d688 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:57,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:57,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:57,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:57,176 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:57,208 DEBUG [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1 2023-07-14 04:03:57,208 DEBUG [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1 2023-07-14 04:03:57,209 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c4e06fb4ecdd3c332880d64437f3855 columnFamilyName f1 2023-07-14 04:03:57,210 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] regionserver.HStore(310): Store=1c4e06fb4ecdd3c332880d64437f3855/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:57,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:57,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:57,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:03:57,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:03:57,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c4e06fb4ecdd3c332880d64437f3855; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65912718, jitterRate=-0.0178239643573761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:03:57,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c4e06fb4ecdd3c332880d64437f3855: 2023-07-14 04:03:57,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855., pid=15, masterSystemTime=1689307437167 2023-07-14 04:03:57,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:03:57,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:03:57,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:03:57,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed1e85127c4d73d8edec872fdc80d2ed, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.', STARTKEY => 's', ENDKEY => ''} 2023-07-14 04:03:57,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:57,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. service=AccessControlService 2023-07-14 04:03:57,227 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307437226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307437226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307437226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307437226"}]},"ts":"1689307437226"} 2023-07-14 04:03:57,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:03:57,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table fb8fce90-ed2c-98d2-b8ee-9608d264d688 ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:57,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:03:57,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:57,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:57,229 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:57,232 DEBUG [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/f1 2023-07-14 04:03:57,232 DEBUG [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/f1 2023-07-14 04:03:57,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-14 04:03:57,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507 in 214 msec 2023-07-14 04:03:57,233 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed1e85127c4d73d8edec872fdc80d2ed columnFamilyName f1 2023-07-14 04:03:57,233 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] regionserver.HStore(310): Store=ed1e85127c4d73d8edec872fdc80d2ed/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:03:57,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN in 375 msec 2023-07-14 04:03:57,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:57,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:57,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:03:57,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:03:57,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed1e85127c4d73d8edec872fdc80d2ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72293323, jitterRate=0.07725445926189423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:03:57,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed1e85127c4d73d8edec872fdc80d2ed: 2023-07-14 04:03:57,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed., pid=16, masterSystemTime=1689307437167 2023-07-14 04:03:57,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:03:57,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:03:57,248 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:03:57,248 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307437248"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307437248"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307437248"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307437248"}]},"ts":"1689307437248"} 2023-07-14 04:03:57,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-14 04:03:57,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507 in 235 msec 2023-07-14 04:03:57,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-14 04:03:57,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN in 396 msec 2023-07-14 04:03:57,257 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 04:03:57,258 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307437258"}]},"ts":"1689307437258"} 2023-07-14 04:03:57,260 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=ENABLED in hbase:meta 2023-07-14 04:03:57,262 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 04:03:57,262 WARN [PEWorker-1] access.AccessController(784): Not adding owner permission for table fb8fce90-ed2c-98d2-b8ee-9608d264d688. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-14 04:03:57,266 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey fb8fce90-ed2c-98d2-b8ee-9608d264d688 owner: RWXCA 2023-07-14 04:03:57,281 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:03:57,309 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 04:03:57,309 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 04:03:57,309 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:03:57,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04 2023-07-14 04:03:57,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04 2023-07-14 04:03:57,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 in 560 msec 2023-07-14 04:03:57,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 04:03:57,365 INFO [Listener at localhost/42791] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, procId: 12 completed 2023-07-14 04:03:57,366 DEBUG [Listener at localhost/42791] hbase.HBaseTestingUtility(3430): Waiting until all regions of table fb8fce90-ed2c-98d2-b8ee-9608d264d688 get assigned. Timeout = 60000ms 2023-07-14 04:03:57,366 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:03:57,369 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(3484): All regions for table fb8fce90-ed2c-98d2-b8ee-9608d264d688 assigned to meta. Checking AM states. 2023-07-14 04:03:57,369 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:03:57,369 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(3504): All regions for table fb8fce90-ed2c-98d2-b8ee-9608d264d688 assigned. 2023-07-14 04:03:57,370 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:03:57,375 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x6c8529ec to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,380 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f6b34de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,381 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:03:57,383 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:03:57,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey fb8fce90-ed2c-98d2-b8ee-9608d264d688 rwuser,f1: RW 2023-07-14 04:03:57,406 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:03:57,406 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:03:57,410 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:03:57,410 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:03:57,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:03:57,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:03:57,412 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:03:57,412 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c8529ec to 127.0.0.1:50593 2023-07-14 04:03:57,412 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,413 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:03:57,414 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x02284e8b to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,418 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15ea5a08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,418 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:03:57,421 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:03:57,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey fb8fce90-ed2c-98d2-b8ee-9608d264d688 rouser,f1: R 2023-07-14 04:03:57,425 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:03:57,425 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rouser,f1: R] 2023-07-14 04:03:57,425 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:03:57,429 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:03:57,429 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:03:57,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:03:57,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:03:57,429 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:03:57,430 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02284e8b to 127.0.0.1:50593 2023-07-14 04:03:57,431 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,431 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:03:57,432 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x326890af to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,435 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@280823ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,437 DEBUG [hconnection-0x68147c72-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,440 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44418, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:03:57,446 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x326890af to 127.0.0.1:50593 2023-07-14 04:03:57,446 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,446 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x300c1e5b to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,456 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e37bf81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,458 DEBUG [hconnection-0x5580c11e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,460 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44420, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:03:57,464 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x300c1e5b to 127.0.0.1:50593 2023-07-14 04:03:57,464 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,465 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x5d131d88 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,469 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ec8af05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,470 DEBUG [hconnection-0x7c0d7284-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,476 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44432, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:03:57,479 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d131d88 to 127.0.0.1:50593 2023-07-14 04:03:57,480 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,480 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x57618e72 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,484 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ef5f48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,486 DEBUG [hconnection-0x190ae8c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,488 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44438, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:03:57,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:03:57,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:44438 deadline: 1689307497491, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) 2023-07-14 04:03:57,509 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57618e72 to 127.0.0.1:50593 2023-07-14 04:03:57,509 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,510 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x10c64f57 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,514 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bc928f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,516 DEBUG [hconnection-0x7e1856c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,519 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44442, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:03:57,524 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10c64f57 to 127.0.0.1:50593 2023-07-14 04:03:57,525 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,525 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x39ac0b8e to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,529 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bed41b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,531 DEBUG [hconnection-0x2ebb602e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,533 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44454, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:03:57,538 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39ac0b8e to 127.0.0.1:50593 2023-07-14 04:03:57,538 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,539 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x7fb0618b to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,573 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@affc443, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,575 DEBUG [hconnection-0x786338d3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,579 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44464, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:03:57,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:03:57,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:44464 deadline: 1689307497582, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) 2023-07-14 04:03:57,587 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fb0618b to 127.0.0.1:50593 2023-07-14 04:03:57,587 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,587 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x17a03bb7 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,593 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76642c30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,595 DEBUG [hconnection-0x247f4bde-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,598 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44480, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:03:57,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:03:57,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:44480 deadline: 1689307497601, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) 2023-07-14 04:03:57,603 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17a03bb7 to 127.0.0.1:50593 2023-07-14 04:03:57,603 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:03:57,603 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x11a8dc9c to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:03:57,609 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f6bd965, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:03:57,611 DEBUG [hconnection-0x5875701a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:03:57,613 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:03:59,022 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'fb8fce90-ed2c-98d2-b8ee-9608d264d688' 2023-07-14 04:03:59,024 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 04:03:59,025 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 04:03:59,025 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 04:03:59,783 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-14 04:04:00,513 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:00,514 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 04:04:00,514 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:00,515 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 04:04:00,515 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 04:04:00,515 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 04:04:00,515 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:00,515 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 04:04:00,515 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 04:04:00,515 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 04:04:10,112 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11a8dc9c to 127.0.0.1:50593 2023-07-14 04:04:10,112 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:10,112 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4ba5b897 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:10,118 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69c7c58e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:10,121 DEBUG [hconnection-0x341c003d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:10,124 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:10,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] regionserver.StoreScanner(1093): Switch to stream read (scanned=262152 bytes) of f1 2023-07-14 04:04:10,358 DEBUG [Listener at localhost/42791] client.ClientScanner(240): Advancing internal scanner to startKey at 's', inclusive 2023-07-14 04:04:10,364 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ba5b897 to 127.0.0.1:50593 2023-07-14 04:04:10,364 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:10,365 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x15e485dc to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:10,377 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x15e485dc] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10bba764, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:10,429 DEBUG [Listener at localhost/42791] client.ConnectionUtils(586): Start fetching master stub from registry 2023-07-14 04:04:10,430 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x15e485dc] client.AsyncConnectionImpl(289): The fetched master address is jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:04:10,434 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x15e485dc] client.ConnectionUtils(594): The fetched master stub is org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$Stub@4c3a4fbb 2023-07-14 04:04:10,438 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x15e485dc] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:10,441 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:10,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } 2023-07-14 04:04:10,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689307450441 (current time:1689307450441). 2023-07-14 04:04:10,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 04:04:10,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x56782649 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:10,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38757ce3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:10,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:10,450 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:10,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56782649 to 127.0.0.1:50593 2023-07-14 04:04:10,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:10,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x456bb012 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:10,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52369c98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:10,467 DEBUG [hconnection-0x41b76059-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:10,469 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:10,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x456bb012 to 127.0.0.1:50593 2023-07-14 04:04:10,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:10,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:10,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rouser,f1: R] 2023-07-14 04:04:10,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:10,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 04:04:10,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } 2023-07-14 04:04:10,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=EXCLUSIVE 2023-07-14 04:04:10,507 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=EXCLUSIVE 2023-07-14 04:04:10,508 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=EXCLUSIVE; timeout=600000, timestamp=1689308050508 2023-07-14 04:04:10,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(653): Started snapshot: { ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } 2023-07-14 04:04:10,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 C_M_SNAPSHOT_TABLE on table fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:10,510 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=EXCLUSIVE 2023-07-14 04:04:10,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=SHARED 2023-07-14 04:04:10,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=EXCLUSIVE in 11 msec 2023-07-14 04:04:10,513 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=SHARED 2023-07-14 04:04:10,514 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=SHARED; timeout=600000, timestamp=1689308050514 2023-07-14 04:04:10,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } is done 2023-07-14 04:04:10,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:10,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } is done 2023-07-14 04:04:10,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:10,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,938 INFO [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' 2023-07-14 04:04:10,938 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 04:04:10,939 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' starting 'acquire' 2023-07-14 04:04:10,939 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205', kicking off acquire phase on members. 2023-07-14 04:04:10,939 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,939 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,941 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 04:04:10,941 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:10,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 04:04:10,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 04:04:10,941 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:10,941 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 04:04:10,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 323 2023-07-14 04:04:10,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,943 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 from table fb8fce90-ed2c-98d2-b8ee-9608d264d688 type FLUSH 2023-07-14 04:04:10,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,945 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' with timeout 300000ms 2023-07-14 04:04:10,945 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 04:04:10,945 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' starting 'acquire' stage 2023-07-14 04:04:10,945 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' locally acquired 2023-07-14 04:04:10,945 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41323,1689307431507' joining acquired barrier for procedure (b081a7b1-3d70-a2dc-4b32-3d1512f59205) in zk 2023-07-14 04:04:10,951 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,951 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:10,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:10,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 04:04:10,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 04:04:10,952 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,952 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 04:04:10,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 04:04:10,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 04:04:10,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 04:04:10,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41323,1689307431507' joining acquired barrier for procedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' on coordinator 2023-07-14 04:04:10,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73004164[Count = 0] remaining members to acquire global barrier 2023-07-14 04:04:10,953 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' starting 'in-barrier' execution. 2023-07-14 04:04:10,954 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,955 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' received 'reached' from coordinator. 2023-07-14 04:04:10,955 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:10,955 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 04:04:10,956 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:10,956 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:10,956 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 2 regions 2023-07-14 04:04:10,956 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 04:04:10,957 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. started... 2023-07-14 04:04:10,957 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. started... 2023-07-14 04:04:10,958 INFO [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1c4e06fb4ecdd3c332880d64437f3855 1/1 column families, dataSize=937.56 KB heapSize=2.98 MB 2023-07-14 04:04:10,959 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for ed1e85127c4d73d8edec872fdc80d2ed: 2023-07-14 04:04:10,960 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.' region-info for snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:10,965 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 04:04:10,968 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 04:04:11,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } is done 2023-07-14 04:04:11,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:11,389 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. completed. 2023-07-14 04:04:11,389 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:11,389 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/2 local region snapshots. 2023-07-14 04:04:11,534 INFO [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=937.56 KB at sequenceid=30006 (bloomFilter=true), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/.tmp/f1/8a409a7778f64cf6925b315907f6cd16 2023-07-14 04:04:11,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } is done 2023-07-14 04:04:11,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:11,577 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/.tmp/f1/8a409a7778f64cf6925b315907f6cd16 as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/8a409a7778f64cf6925b315907f6cd16 2023-07-14 04:04:11,586 INFO [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/8a409a7778f64cf6925b315907f6cd16, entries=30002, sequenceid=30006, filesize=1.1 M 2023-07-14 04:04:11,588 INFO [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~937.56 KB/960064, heapSize ~2.98 MB/3120448, currentSize=0 B/0 for 1c4e06fb4ecdd3c332880d64437f3855 in 631ms, sequenceid=30006, compaction requested=false 2023-07-14 04:04:11,589 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c4e06fb4ecdd3c332880d64437f3855: 2023-07-14 04:04:11,589 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.' region-info for snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:11,589 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 04:04:11,589 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/8a409a7778f64cf6925b315907f6cd16] hfiles 2023-07-14 04:04:11,589 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/8a409a7778f64cf6925b315907f6cd16 for snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,004 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. completed. 2023-07-14 04:04:12,004 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:12,004 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/2 local region snapshots. 2023-07-14 04:04:12,005 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 2 local region snapshots. 2023-07-14 04:04:12,005 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,005 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' locally completed 2023-07-14 04:04:12,005 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' completed for member 'jenkins-hbase4.apache.org,41323,1689307431507' in zk 2023-07-14 04:04:12,009 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,009 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' has notified controller of completion 2023-07-14 04:04:12,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 04:04:12,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 04:04:12,009 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 04:04:12,009 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' completed. 2023-07-14 04:04:12,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 04:04:12,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 04:04:12,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 04:04:12,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' member 'jenkins-hbase4.apache.org,41323,1689307431507': 2023-07-14 04:04:12,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41323,1689307431507' released barrier for procedure'b081a7b1-3d70-a2dc-4b32-3d1512f59205', counting down latch. Waiting for 0 more 2023-07-14 04:04:12,012 INFO [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'b081a7b1-3d70-a2dc-4b32-3d1512f59205' execution completed 2023-07-14 04:04:12,012 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 04:04:12,013 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 04:04:12,013 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,013 INFO [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure b081a7b1-3d70-a2dc-4b32-3d1512f59205including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 04:04:12,015 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,015 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 04:04:12,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,015 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 04:04:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 04:04:12,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 04:04:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 04:04:12,015 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 04:04:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 04:04:12,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,017 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 04:04:12,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,024 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,024 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,024 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 04:04:12,024 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 04:04:12,025 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:12,024 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 04:04:12,025 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,025 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 04:04:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 04:04:12,025 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,025 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,025 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 04:04:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 04:04:12,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp/b081a7b1-3d70-a2dc-4b32-3d1512f59205 to hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:12,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } is done 2023-07-14 04:04:12,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:13,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 of table fb8fce90-ed2c-98d2-b8ee-9608d264d688 completed 2023-07-14 04:04:13,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:13,294 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp/b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:13,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 C_M_SNAPSHOT_TABLE on table fb8fce90-ed2c-98d2-b8ee-9608d264d688 at 1689307450509Consolidate snapshot: b081a7b1-3d70-a2dc-4b32-3d1512f59205 at 1689307452025 (+1516 ms)Loading Region manifests for b081a7b1-3d70-a2dc-4b32-3d1512f59205 at 1689307452026 (+1 ms)Writing data manifest for b081a7b1-3d70-a2dc-4b32-3d1512f59205 at 1689307452038 (+12 ms)Verifying snapshot: b081a7b1-3d70-a2dc-4b32-3d1512f59205 at 1689307452453 (+415 ms)Snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 of table fb8fce90-ed2c-98d2-b8ee-9608d264d688 completed at 1689307453293 (+840 ms) 2023-07-14 04:04:13,295 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=SHARED 2023-07-14 04:04:13,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, type=SHARED in 2.7850 sec 2023-07-14 04:04:14,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } is done 2023-07-14 04:04:14,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(401): Snapshot '{ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 04:04:14,585 INFO [Listener at localhost/42791] client.AsyncConnectionImpl(207): Connection has been closed by Listener at localhost/42791. 2023-07-14 04:04:14,585 DEBUG [Listener at localhost/42791] client.AsyncConnectionImpl(232): Call stack: at java.lang.Thread.getStackTrace(Thread.java:1564) at org.apache.hadoop.hbase.client.AsyncConnectionImpl.close(AsyncConnectionImpl.java:209) at org.apache.hadoop.hbase.client.TestSnapshotWithAclAsyncAdmin.snapshot(TestSnapshotWithAclAsyncAdmin.java:39) at org.apache.hadoop.hbase.client.SnapshotWithAclTestBase.testRestoreSnapshot(SnapshotWithAclTestBase.java:188) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-14 04:04:14,592 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:14,593 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15e485dc to 127.0.0.1:50593 2023-07-14 04:04:14,593 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x08877fe4 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:14,598 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x08877fe4] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a80d941, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:14,604 DEBUG [Listener at localhost/42791] client.ConnectionUtils(586): Start fetching meta region location from registry 2023-07-14 04:04:14,605 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x08877fe4] client.ConnectionUtils(594): The fetched meta region location is [region=hbase:meta,,1.1588230740, hostname=jenkins-hbase4.apache.org,41323,1689307431507, seqNum=-1] 2023-07-14 04:04:14,608 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:14,610 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:14,613 DEBUG [RPCClient-NioEventLoopGroup-4-16] client.ConnectionUtils(586): Start fetching master stub from registry 2023-07-14 04:04:14,613 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x08877fe4] client.AsyncConnectionImpl(289): The fetched master address is jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:04:14,613 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x08877fe4] client.ConnectionUtils(594): The fetched master stub is org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$Stub@1ebf5ec9 2023-07-14 04:04:14,618 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x08877fe4] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:14,619 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:14,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CLONE_SNAPSHOT_PRE_OPERATION; CloneSnapshotProcedure (table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 ) 2023-07-14 04:04:14,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(750): Clone snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 as table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:14,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-14 04:04:14,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-14 04:04:14,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-14 04:04:15,060 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/.tabledesc/.tableinfo.0000000001 2023-07-14 04:04:15,068 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 2023-07-14 04:04:15,069 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,070 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(239): region to add: 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:15,070 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(239): region to add: ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:15,070 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(585): clone region=1c4e06fb4ecdd3c332880d64437f3855 as 0f2eea6700e10bddc1ac7d4b1060ce90 in snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:15,070 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(585): clone region=ed1e85127c4d73d8edec872fdc80d2ed as 41a51de638de0117d4dfe44d18aed927 in snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:15,071 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f2eea6700e10bddc1ac7d4b1060ce90, NAME => '3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90.', STARTKEY => '', ENDKEY => 's'}, tableDescriptor='3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:04:15,073 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7675): creating {ENCODED => 41a51de638de0117d4dfe44d18aed927, NAME => '3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927.', STARTKEY => 's', ENDKEY => ''}, tableDescriptor='3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:04:15,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-14 04:04:15,492 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(866): Instantiated 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:15,492 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(866): Instantiated 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:15,493 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8a409a7778f64cf6925b315907f6cd16 from cloned region in snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 to table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,493 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1604): Closing 41a51de638de0117d4dfe44d18aed927, disabling compactions & flushes 2023-07-14 04:04:15,493 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1626): Closing region 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:15,494 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:15,494 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1714): Acquired close lock on 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. after waiting 0 ms 2023-07-14 04:04:15,494 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1724): Updates disabled for region 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:15,494 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1838): Closed 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:15,494 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1558): Region close journal for 41a51de638de0117d4dfe44d18aed927: 2023-07-14 04:04:15,500 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1604): Closing 0f2eea6700e10bddc1ac7d4b1060ce90, disabling compactions & flushes 2023-07-14 04:04:15,500 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1626): Closing region 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1714): Acquired close lock on 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. after waiting 0 ms 2023-07-14 04:04:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1724): Updates disabled for region 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:15,501 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1838): Closed 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1558): Region close journal for 0f2eea6700e10bddc1ac7d4b1060ce90: 2023-07-14 04:04:15,502 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 2023-07-14 04:04:15,502 INFO [PEWorker-1] procedure.CloneSnapshotProcedure$1(421): Clone snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 on table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf completed! 2023-07-14 04:04:15,507 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307455507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307455507"}]},"ts":"1689307455507"} 2023-07-14 04:04:15,507 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307455507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307455507"}]},"ts":"1689307455507"} 2023-07-14 04:04:15,512 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 04:04:15,513 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307455513"}]},"ts":"1689307455513"} 2023-07-14 04:04:15,514 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, state=ENABLING in hbase:meta 2023-07-14 04:04:15,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, region=0f2eea6700e10bddc1ac7d4b1060ce90, ASSIGN}, {pid=21, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, region=41a51de638de0117d4dfe44d18aed927, ASSIGN}] 2023-07-14 04:04:15,521 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, region=0f2eea6700e10bddc1ac7d4b1060ce90, ASSIGN 2023-07-14 04:04:15,522 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, region=41a51de638de0117d4dfe44d18aed927, ASSIGN 2023-07-14 04:04:15,522 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, region=0f2eea6700e10bddc1ac7d4b1060ce90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:04:15,522 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=21, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, region=41a51de638de0117d4dfe44d18aed927, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:04:15,674 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0f2eea6700e10bddc1ac7d4b1060ce90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:15,674 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=41a51de638de0117d4dfe44d18aed927, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:15,674 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307455674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307455674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307455674"}]},"ts":"1689307455674"} 2023-07-14 04:04:15,674 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307455674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307455674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307455674"}]},"ts":"1689307455674"} 2023-07-14 04:04:15,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure 0f2eea6700e10bddc1ac7d4b1060ce90, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:15,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=21, state=RUNNABLE; OpenRegionProcedure 41a51de638de0117d4dfe44d18aed927, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:15,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-14 04:04:15,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:15,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f2eea6700e10bddc1ac7d4b1060ce90, NAME => '3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90.', STARTKEY => '', ENDKEY => 's'} 2023-07-14 04:04:15,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. service=AccessControlService 2023-07-14 04:04:15,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:15,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 0f2eea6700e10bddc1ac7d4b1060ce90 2023-07-14 04:04:15,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:15,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f2eea6700e10bddc1ac7d4b1060ce90 2023-07-14 04:04:15,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f2eea6700e10bddc1ac7d4b1060ce90 2023-07-14 04:04:15,837 INFO [StoreOpener-0f2eea6700e10bddc1ac7d4b1060ce90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0f2eea6700e10bddc1ac7d4b1060ce90 2023-07-14 04:04:15,838 DEBUG [StoreOpener-0f2eea6700e10bddc1ac7d4b1060ce90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/f1 2023-07-14 04:04:15,838 DEBUG [StoreOpener-0f2eea6700e10bddc1ac7d4b1060ce90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/f1 2023-07-14 04:04:15,839 INFO [StoreOpener-0f2eea6700e10bddc1ac7d4b1060ce90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f2eea6700e10bddc1ac7d4b1060ce90 columnFamilyName f1 2023-07-14 04:04:15,850 DEBUG [StoreOpener-0f2eea6700e10bddc1ac7d4b1060ce90-1] regionserver.HStore(539): loaded hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/f1/fb8fce90-ed2c-98d2-b8ee-9608d264d688=1c4e06fb4ecdd3c332880d64437f3855-8a409a7778f64cf6925b315907f6cd16 2023-07-14 04:04:15,851 INFO [StoreOpener-0f2eea6700e10bddc1ac7d4b1060ce90-1] regionserver.HStore(310): Store=0f2eea6700e10bddc1ac7d4b1060ce90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:15,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90 2023-07-14 04:04:15,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90 2023-07-14 04:04:15,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f2eea6700e10bddc1ac7d4b1060ce90 2023-07-14 04:04:15,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/recovered.edits/30006.seqid, newMaxSeqId=30006, maxSeqId=-1 2023-07-14 04:04:15,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f2eea6700e10bddc1ac7d4b1060ce90; next sequenceid=30007; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63052917, jitterRate=-0.06043832004070282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:15,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f2eea6700e10bddc1ac7d4b1060ce90: 2023-07-14 04:04:15,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90., pid=22, masterSystemTime=1689307455828 2023-07-14 04:04:15,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:15,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:15,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:15,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41a51de638de0117d4dfe44d18aed927, NAME => '3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927.', STARTKEY => 's', ENDKEY => ''} 2023-07-14 04:04:15,863 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0f2eea6700e10bddc1ac7d4b1060ce90, regionState=OPEN, openSeqNum=30007, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:15,863 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307455863"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307455863"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307455863"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307455863"}]},"ts":"1689307455863"} 2023-07-14 04:04:15,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. service=AccessControlService 2023-07-14 04:04:15,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:15,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 41a51de638de0117d4dfe44d18aed927 2023-07-14 04:04:15,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:15,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41a51de638de0117d4dfe44d18aed927 2023-07-14 04:04:15,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41a51de638de0117d4dfe44d18aed927 2023-07-14 04:04:15,865 INFO [StoreOpener-41a51de638de0117d4dfe44d18aed927-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41a51de638de0117d4dfe44d18aed927 2023-07-14 04:04:15,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-07-14 04:04:15,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure 0f2eea6700e10bddc1ac7d4b1060ce90, server=jenkins-hbase4.apache.org,41323,1689307431507 in 188 msec 2023-07-14 04:04:15,868 DEBUG [StoreOpener-41a51de638de0117d4dfe44d18aed927-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/41a51de638de0117d4dfe44d18aed927/f1 2023-07-14 04:04:15,868 DEBUG [StoreOpener-41a51de638de0117d4dfe44d18aed927-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/41a51de638de0117d4dfe44d18aed927/f1 2023-07-14 04:04:15,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, region=0f2eea6700e10bddc1ac7d4b1060ce90, ASSIGN in 347 msec 2023-07-14 04:04:15,868 INFO [StoreOpener-41a51de638de0117d4dfe44d18aed927-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41a51de638de0117d4dfe44d18aed927 columnFamilyName f1 2023-07-14 04:04:15,869 INFO [StoreOpener-41a51de638de0117d4dfe44d18aed927-1] regionserver.HStore(310): Store=41a51de638de0117d4dfe44d18aed927/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:15,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/41a51de638de0117d4dfe44d18aed927 2023-07-14 04:04:15,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/41a51de638de0117d4dfe44d18aed927 2023-07-14 04:04:15,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41a51de638de0117d4dfe44d18aed927 2023-07-14 04:04:15,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/41a51de638de0117d4dfe44d18aed927/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:04:15,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41a51de638de0117d4dfe44d18aed927; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66674274, jitterRate=-0.006475895643234253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:15,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41a51de638de0117d4dfe44d18aed927: 2023-07-14 04:04:15,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927., pid=23, masterSystemTime=1689307455828 2023-07-14 04:04:15,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:15,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:15,881 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=41a51de638de0117d4dfe44d18aed927, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:15,881 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307455881"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307455881"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307455881"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307455881"}]},"ts":"1689307455881"} 2023-07-14 04:04:15,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-14 04:04:15,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; OpenRegionProcedure 41a51de638de0117d4dfe44d18aed927, server=jenkins-hbase4.apache.org,41323,1689307431507 in 205 msec 2023-07-14 04:04:15,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-07-14 04:04:15,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, region=41a51de638de0117d4dfe44d18aed927, ASSIGN in 365 msec 2023-07-14 04:04:15,889 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307455889"}]},"ts":"1689307455889"} 2023-07-14 04:04:15,890 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, state=ENABLED in hbase:meta 2023-07-14 04:04:15,893 DEBUG [PEWorker-3] zookeeper.ReadOnlyZKClient(139): Connect 0x28cdf28d to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:15,897 DEBUG [PEWorker-3] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dfaa586, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:15,898 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:15,901 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:15,902 DEBUG [PEWorker-3] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28cdf28d to 127.0.0.1:50593 2023-07-14 04:04:15,902 DEBUG [PEWorker-3] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:15,903 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(841): Restore snapshot acl to table. snapshot: name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 , table: 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,904 DEBUG [PEWorker-3] zookeeper.ReadOnlyZKClient(139): Connect 0x616c12ee to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:15,908 DEBUG [PEWorker-3] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2672cdd4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:15,913 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:15,915 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:15,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x29209d15 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:15,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ce38f04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:15,921 DEBUG [hconnection-0x420e5de1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:15,923 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:15,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29209d15 to 127.0.0.1:50593 2023-07-14 04:04:15,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:15,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf owner: RWXCA 2023-07-14 04:04:15,928 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [owner: RWXCA] 2023-07-14 04:04:15,929 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 04:04:15,930 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 04:04:15,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:15,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:15,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04 2023-07-14 04:04:15,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04 2023-07-14 04:04:15,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x721876f0 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:15,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42c9cc07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:15,946 DEBUG [hconnection-0x1893c61b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:15,947 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:15,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x721876f0 to 127.0.0.1:50593 2023-07-14 04:04:15,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:15,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [owner: RWXCA] 2023-07-14 04:04:15,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf rouser,f1: R 2023-07-14 04:04:15,954 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [owner: RWXCA] 2023-07-14 04:04:15,954 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [rouser,f1: R] 2023-07-14 04:04:15,958 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,958 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 2023-07-14 04:04:15,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 2023-07-14 04:04:15,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x7d1306f0 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:15,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bb6a457, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:15,974 DEBUG [hconnection-0x7bbf9623-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:15,975 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:15,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d1306f0 to 127.0.0.1:50593 2023-07-14 04:04:15,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:15,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [owner: RWXCA] 2023-07-14 04:04:15,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [rouser,f1: R] 2023-07-14 04:04:15,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf rwuser,f1: RW 2023-07-14 04:04:15,980 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [owner: RWXCA] 2023-07-14 04:04:15,981 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [rouser,f1: R] 2023-07-14 04:04:15,981 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [rwuser,f1: RW] 2023-07-14 04:04:15,987 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,987 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,987 INFO [PEWorker-3] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:15,987 DEBUG [PEWorker-3] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x616c12ee to 127.0.0.1:50593 2023-07-14 04:04:15,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 \x01 2023-07-14 04:04:15,987 DEBUG [PEWorker-3] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:15,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 \x01 2023-07-14 04:04:15,989 WARN [PEWorker-3] access.AccessController(784): Not adding owner permission for table 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-14 04:04:15,989 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf owner: RWXCA 2023-07-14 04:04:15,991 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [owner: RWXCA] 2023-07-14 04:04:15,991 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [rouser,f1: R] 2023-07-14 04:04:15,991 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf], kv [rwuser,f1: RW] 2023-07-14 04:04:15,993 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,993 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf 2023-07-14 04:04:15,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 \x01 2023-07-14 04:04:15,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 \x01 2023-07-14 04:04:15,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CloneSnapshotProcedure (table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 ) in 1.3610 sec 2023-07-14 04:04:16,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-14 04:04:16,806 INFO [Listener at localhost/42791] client.AsyncConnectionImpl(207): Connection has been closed by Listener at localhost/42791. 2023-07-14 04:04:16,806 DEBUG [Listener at localhost/42791] client.AsyncConnectionImpl(232): Call stack: at java.lang.Thread.getStackTrace(Thread.java:1564) at org.apache.hadoop.hbase.client.AsyncConnectionImpl.close(AsyncConnectionImpl.java:209) at org.apache.hadoop.hbase.client.TestSnapshotWithAclAsyncAdmin.cloneSnapshot(TestSnapshotWithAclAsyncAdmin.java:48) at org.apache.hadoop.hbase.client.SnapshotWithAclTestBase.testRestoreSnapshot(SnapshotWithAclTestBase.java:192) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-14 04:04:16,806 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:16,806 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08877fe4 to 127.0.0.1:50593 2023-07-14 04:04:16,807 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x37b30bd4 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:16,815 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cc0951b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:16,817 DEBUG [hconnection-0xb6aad1a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:16,818 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:16,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] regionserver.StoreScanner(1093): Switch to stream read (scanned=262152 bytes) of f1 2023-07-14 04:04:17,026 DEBUG [Listener at localhost/42791] client.ClientScanner(240): Advancing internal scanner to startKey at 's', inclusive 2023-07-14 04:04:17,028 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table '3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf' 2023-07-14 04:04:17,032 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37b30bd4 to 127.0.0.1:50593 2023-07-14 04:04:17,032 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,032 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x41f12689 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,038 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c4921a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,040 DEBUG [hconnection-0x28b248a3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,042 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41510, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,049 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41f12689 to 127.0.0.1:50593 2023-07-14 04:04:17,049 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,049 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x07de15a2 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,055 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d93a2aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,058 DEBUG [hconnection-0x630b59b6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,059 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41518, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,063 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07de15a2 to 127.0.0.1:50593 2023-07-14 04:04:17,063 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,063 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4f8c2759 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,068 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@767311f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,071 DEBUG [hconnection-0x1feee064-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,072 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41528, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,076 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f8c2759 to 127.0.0.1:50593 2023-07-14 04:04:17,076 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,076 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x620449b8 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,081 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a01685c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,082 DEBUG [hconnection-0x5adbbb47-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,084 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41534, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:17,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:41534 deadline: 1689307517086, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, action=READ) 2023-07-14 04:04:17,087 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x620449b8 to 127.0.0.1:50593 2023-07-14 04:04:17,087 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,088 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x27d17331 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,092 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2057f50f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,094 DEBUG [hconnection-0x15fea508-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,095 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41536, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,098 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27d17331 to 127.0.0.1:50593 2023-07-14 04:04:17,098 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,099 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x1db385d0 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,104 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d05b58b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,105 DEBUG [hconnection-0x692ef45e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,107 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41550, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,110 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1db385d0 to 127.0.0.1:50593 2023-07-14 04:04:17,110 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,111 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x25bde9c4 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,114 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b2f6529, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,116 DEBUG [hconnection-0xe68959d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,118 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41560, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, family=f1:cq, params=[table=default:3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:17,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:41560 deadline: 1689307517120, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, family=f1:cq, params=[table=default:3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,family=f1:cq],action=WRITE) 2023-07-14 04:04:17,121 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25bde9c4 to 127.0.0.1:50593 2023-07-14 04:04:17,121 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,122 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x541b33e7 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,126 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e959084, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,131 DEBUG [hconnection-0x6153498c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,132 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41568, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, family=f1:cq, params=[table=default:3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:17,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:41568 deadline: 1689307517135, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf, family=f1:cq, params=[table=default:3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,family=f1:cq],action=WRITE) 2023-07-14 04:04:17,136 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x541b33e7 to 127.0.0.1:50593 2023-07-14 04:04:17,136 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:17,137 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x228b3eed to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:17,140 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x228b3eed] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6714cc5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:17,141 DEBUG [Listener at localhost/42791] client.ConnectionUtils(586): Start fetching meta region location from registry 2023-07-14 04:04:17,142 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x228b3eed] client.ConnectionUtils(594): The fetched meta region location is [region=hbase:meta,,1.1588230740, hostname=jenkins-hbase4.apache.org,41323,1689307431507, seqNum=-1] 2023-07-14 04:04:17,142 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x228b3eed] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:17,143 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:17,144 DEBUG [RPCClient-NioEventLoopGroup-4-11] client.ConnectionUtils(586): Start fetching master stub from registry 2023-07-14 04:04:17,145 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x228b3eed] client.AsyncConnectionImpl(289): The fetched master address is jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:04:17,145 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x228b3eed] client.ConnectionUtils(594): The fetched master stub is org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$Stub@632b5464 2023-07-14 04:04:17,145 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x228b3eed] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:17,147 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:17,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE:CLONE_SNAPSHOT_PRE_OPERATION; CloneSnapshotProcedure (table=21c62941-a65c-d243-9db6-4c9e6ea96601 snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 ) 2023-07-14 04:04:17,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(750): Clone snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 as table=21c62941-a65c-d243-9db6-4c9e6ea96601 2023-07-14 04:04:17,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-14 04:04:17,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-14 04:04:17,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-14 04:04:17,576 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/.tabledesc/.tableinfo.0000000001 2023-07-14 04:04:17,580 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 2023-07-14 04:04:17,580 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601 2023-07-14 04:04:17,580 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(239): region to add: 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:17,581 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(239): region to add: ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:17,581 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(585): clone region=1c4e06fb4ecdd3c332880d64437f3855 as 1d6e377eb8c5e4e300c0bbbc865ff89a in snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:17,581 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(585): clone region=ed1e85127c4d73d8edec872fdc80d2ed as 36cb8b501ab4c7a9c4ed36010727c7fd in snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 2023-07-14 04:04:17,581 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1d6e377eb8c5e4e300c0bbbc865ff89a, NAME => '21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a.', STARTKEY => '', ENDKEY => 's'}, tableDescriptor='21c62941-a65c-d243-9db6-4c9e6ea96601', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:04:17,582 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7675): creating {ENCODED => 36cb8b501ab4c7a9c4ed36010727c7fd, NAME => '21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd.', STARTKEY => 's', ENDKEY => ''}, tableDescriptor='21c62941-a65c-d243-9db6-4c9e6ea96601', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:04:17,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-14 04:04:17,996 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(866): Instantiated 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:17,996 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(866): Instantiated 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:17,997 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8a409a7778f64cf6925b315907f6cd16 from cloned region in snapshot b081a7b1-3d70-a2dc-4b32-3d1512f59205 to table=21c62941-a65c-d243-9db6-4c9e6ea96601 2023-07-14 04:04:17,997 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1604): Closing 36cb8b501ab4c7a9c4ed36010727c7fd, disabling compactions & flushes 2023-07-14 04:04:17,997 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1626): Closing region 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:17,997 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:17,997 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1714): Acquired close lock on 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. after waiting 0 ms 2023-07-14 04:04:17,997 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1724): Updates disabled for region 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:17,997 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1838): Closed 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:17,997 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1558): Region close journal for 36cb8b501ab4c7a9c4ed36010727c7fd: 2023-07-14 04:04:18,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1604): Closing 1d6e377eb8c5e4e300c0bbbc865ff89a, disabling compactions & flushes 2023-07-14 04:04:18,005 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1626): Closing region 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:18,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:18,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1714): Acquired close lock on 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. after waiting 0 ms 2023-07-14 04:04:18,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1724): Updates disabled for region 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:18,006 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1838): Closed 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:18,006 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1558): Region close journal for 1d6e377eb8c5e4e300c0bbbc865ff89a: 2023-07-14 04:04:18,006 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 2023-07-14 04:04:18,006 INFO [PEWorker-5] procedure.CloneSnapshotProcedure$1(421): Clone snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 on table=21c62941-a65c-d243-9db6-4c9e6ea96601 completed! 2023-07-14 04:04:18,010 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307458010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307458010"}]},"ts":"1689307458010"} 2023-07-14 04:04:18,010 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307458010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307458010"}]},"ts":"1689307458010"} 2023-07-14 04:04:18,013 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 04:04:18,014 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"21c62941-a65c-d243-9db6-4c9e6ea96601","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307458014"}]},"ts":"1689307458014"} 2023-07-14 04:04:18,015 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=21c62941-a65c-d243-9db6-4c9e6ea96601, state=ENABLING in hbase:meta 2023-07-14 04:04:18,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=21c62941-a65c-d243-9db6-4c9e6ea96601, region=1d6e377eb8c5e4e300c0bbbc865ff89a, ASSIGN}, {pid=26, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=21c62941-a65c-d243-9db6-4c9e6ea96601, region=36cb8b501ab4c7a9c4ed36010727c7fd, ASSIGN}] 2023-07-14 04:04:18,020 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=21c62941-a65c-d243-9db6-4c9e6ea96601, region=1d6e377eb8c5e4e300c0bbbc865ff89a, ASSIGN 2023-07-14 04:04:18,020 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=26, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=21c62941-a65c-d243-9db6-4c9e6ea96601, region=36cb8b501ab4c7a9c4ed36010727c7fd, ASSIGN 2023-07-14 04:04:18,021 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=21c62941-a65c-d243-9db6-4c9e6ea96601, region=1d6e377eb8c5e4e300c0bbbc865ff89a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:04:18,021 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=26, ppid=24, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=21c62941-a65c-d243-9db6-4c9e6ea96601, region=36cb8b501ab4c7a9c4ed36010727c7fd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:04:18,172 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=1d6e377eb8c5e4e300c0bbbc865ff89a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:18,172 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=36cb8b501ab4c7a9c4ed36010727c7fd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:18,172 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307458172"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307458172"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307458172"}]},"ts":"1689307458172"} 2023-07-14 04:04:18,172 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307458172"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307458172"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307458172"}]},"ts":"1689307458172"} 2023-07-14 04:04:18,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=25, state=RUNNABLE; OpenRegionProcedure 1d6e377eb8c5e4e300c0bbbc865ff89a, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:18,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=26, state=RUNNABLE; OpenRegionProcedure 36cb8b501ab4c7a9c4ed36010727c7fd, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:18,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-14 04:04:18,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:18,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1d6e377eb8c5e4e300c0bbbc865ff89a, NAME => '21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a.', STARTKEY => '', ENDKEY => 's'} 2023-07-14 04:04:18,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. service=AccessControlService 2023-07-14 04:04:18,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:18,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table 21c62941-a65c-d243-9db6-4c9e6ea96601 1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:18,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:18,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:18,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:18,332 INFO [StoreOpener-1d6e377eb8c5e4e300c0bbbc865ff89a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:18,333 DEBUG [StoreOpener-1d6e377eb8c5e4e300c0bbbc865ff89a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/f1 2023-07-14 04:04:18,334 DEBUG [StoreOpener-1d6e377eb8c5e4e300c0bbbc865ff89a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/f1 2023-07-14 04:04:18,334 INFO [StoreOpener-1d6e377eb8c5e4e300c0bbbc865ff89a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d6e377eb8c5e4e300c0bbbc865ff89a columnFamilyName f1 2023-07-14 04:04:18,341 DEBUG [StoreOpener-1d6e377eb8c5e4e300c0bbbc865ff89a-1] regionserver.HStore(539): loaded hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/f1/fb8fce90-ed2c-98d2-b8ee-9608d264d688=1c4e06fb4ecdd3c332880d64437f3855-8a409a7778f64cf6925b315907f6cd16 2023-07-14 04:04:18,341 INFO [StoreOpener-1d6e377eb8c5e4e300c0bbbc865ff89a-1] regionserver.HStore(310): Store=1d6e377eb8c5e4e300c0bbbc865ff89a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:18,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:18,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:18,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:18,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/recovered.edits/30006.seqid, newMaxSeqId=30006, maxSeqId=-1 2023-07-14 04:04:18,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1d6e377eb8c5e4e300c0bbbc865ff89a; next sequenceid=30007; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66969042, jitterRate=-0.002083510160446167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:18,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1d6e377eb8c5e4e300c0bbbc865ff89a: 2023-07-14 04:04:18,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a., pid=27, masterSystemTime=1689307458325 2023-07-14 04:04:18,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:18,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:18,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36cb8b501ab4c7a9c4ed36010727c7fd, NAME => '21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd.', STARTKEY => 's', ENDKEY => ''} 2023-07-14 04:04:18,352 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=1d6e377eb8c5e4e300c0bbbc865ff89a, regionState=OPEN, openSeqNum=30007, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. service=AccessControlService 2023-07-14 04:04:18,352 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307458352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307458352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307458352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307458352"}]},"ts":"1689307458352"} 2023-07-14 04:04:18,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table 21c62941-a65c-d243-9db6-4c9e6ea96601 36cb8b501ab4c7a9c4ed36010727c7fd 2023-07-14 04:04:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36cb8b501ab4c7a9c4ed36010727c7fd 2023-07-14 04:04:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36cb8b501ab4c7a9c4ed36010727c7fd 2023-07-14 04:04:18,355 INFO [StoreOpener-36cb8b501ab4c7a9c4ed36010727c7fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36cb8b501ab4c7a9c4ed36010727c7fd 2023-07-14 04:04:18,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=25 2023-07-14 04:04:18,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=25, state=SUCCESS; OpenRegionProcedure 1d6e377eb8c5e4e300c0bbbc865ff89a, server=jenkins-hbase4.apache.org,41323,1689307431507 in 179 msec 2023-07-14 04:04:18,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; TransitRegionStateProcedure table=21c62941-a65c-d243-9db6-4c9e6ea96601, region=1d6e377eb8c5e4e300c0bbbc865ff89a, ASSIGN in 337 msec 2023-07-14 04:04:18,360 DEBUG [StoreOpener-36cb8b501ab4c7a9c4ed36010727c7fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/36cb8b501ab4c7a9c4ed36010727c7fd/f1 2023-07-14 04:04:18,360 DEBUG [StoreOpener-36cb8b501ab4c7a9c4ed36010727c7fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/36cb8b501ab4c7a9c4ed36010727c7fd/f1 2023-07-14 04:04:18,361 INFO [StoreOpener-36cb8b501ab4c7a9c4ed36010727c7fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36cb8b501ab4c7a9c4ed36010727c7fd columnFamilyName f1 2023-07-14 04:04:18,361 INFO [StoreOpener-36cb8b501ab4c7a9c4ed36010727c7fd-1] regionserver.HStore(310): Store=36cb8b501ab4c7a9c4ed36010727c7fd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:18,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/36cb8b501ab4c7a9c4ed36010727c7fd 2023-07-14 04:04:18,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/36cb8b501ab4c7a9c4ed36010727c7fd 2023-07-14 04:04:18,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36cb8b501ab4c7a9c4ed36010727c7fd 2023-07-14 04:04:18,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/36cb8b501ab4c7a9c4ed36010727c7fd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:04:18,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36cb8b501ab4c7a9c4ed36010727c7fd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65157116, jitterRate=-0.029083311557769775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:18,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36cb8b501ab4c7a9c4ed36010727c7fd: 2023-07-14 04:04:18,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd., pid=28, masterSystemTime=1689307458325 2023-07-14 04:04:18,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:18,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:18,371 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=36cb8b501ab4c7a9c4ed36010727c7fd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:18,371 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307458371"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307458371"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307458371"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307458371"}]},"ts":"1689307458371"} 2023-07-14 04:04:18,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=26 2023-07-14 04:04:18,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=26, state=SUCCESS; OpenRegionProcedure 36cb8b501ab4c7a9c4ed36010727c7fd, server=jenkins-hbase4.apache.org,41323,1689307431507 in 198 msec 2023-07-14 04:04:18,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=24 2023-07-14 04:04:18,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=24, state=SUCCESS; TransitRegionStateProcedure table=21c62941-a65c-d243-9db6-4c9e6ea96601, region=36cb8b501ab4c7a9c4ed36010727c7fd, ASSIGN in 356 msec 2023-07-14 04:04:18,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"21c62941-a65c-d243-9db6-4c9e6ea96601","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307458376"}]},"ts":"1689307458376"} 2023-07-14 04:04:18,377 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=21c62941-a65c-d243-9db6-4c9e6ea96601, state=ENABLED in hbase:meta 2023-07-14 04:04:18,380 WARN [PEWorker-2] access.AccessController(784): Not adding owner permission for table 21c62941-a65c-d243-9db6-4c9e6ea96601. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-14 04:04:18,380 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey 21c62941-a65c-d243-9db6-4c9e6ea96601 owner: RWXCA 2023-07-14 04:04:18,381 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[21c62941-a65c-d243-9db6-4c9e6ea96601], kv [owner: RWXCA] 2023-07-14 04:04:18,383 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 04:04:18,383 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 04:04:18,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:18,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:18,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 21c62941-a65c-d243-9db6-4c9e6ea96601 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$21c62941-a65c-d243-9db6-4c9e6ea96601 \x00 \x01 \x02 \x03 \x04 2023-07-14 04:04:18,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 21c62941-a65c-d243-9db6-4c9e6ea96601 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$21c62941-a65c-d243-9db6-4c9e6ea96601 \x00 \x01 \x02 \x03 \x04 2023-07-14 04:04:18,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 \x01 2023-07-14 04:04:18,386 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 \x01 2023-07-14 04:04:18,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; CloneSnapshotProcedure (table=21c62941-a65c-d243-9db6-4c9e6ea96601 snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 ) in 1.2290 sec 2023-07-14 04:04:19,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-14 04:04:19,305 INFO [Listener at localhost/42791] client.AsyncConnectionImpl(207): Connection has been closed by Listener at localhost/42791. 2023-07-14 04:04:19,305 DEBUG [Listener at localhost/42791] client.AsyncConnectionImpl(232): Call stack: at java.lang.Thread.getStackTrace(Thread.java:1564) at org.apache.hadoop.hbase.client.AsyncConnectionImpl.close(AsyncConnectionImpl.java:209) at org.apache.hadoop.hbase.client.TestSnapshotWithAclAsyncAdmin.cloneSnapshot(TestSnapshotWithAclAsyncAdmin.java:48) at org.apache.hadoop.hbase.client.SnapshotWithAclTestBase.testRestoreSnapshot(SnapshotWithAclTestBase.java:201) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-14 04:04:19,305 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,306 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x228b3eed to 127.0.0.1:50593 2023-07-14 04:04:19,306 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x18c5b92a to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,311 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63428089, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,313 DEBUG [hconnection-0x42ec572c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,314 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] regionserver.StoreScanner(1093): Switch to stream read (scanned=262152 bytes) of f1 2023-07-14 04:04:19,399 DEBUG [Listener at localhost/42791] client.ClientScanner(240): Advancing internal scanner to startKey at 's', inclusive 2023-07-14 04:04:19,404 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18c5b92a to 127.0.0.1:50593 2023-07-14 04:04:19,404 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,405 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x2acd971a to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,411 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27cc91e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,412 DEBUG [hconnection-0x5f1262f2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,413 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41576, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,417 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2acd971a to 127.0.0.1:50593 2023-07-14 04:04:19,417 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,418 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4998d032 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,426 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d12e01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,428 DEBUG [hconnection-0x11293a2d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,429 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41578, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=21c62941-a65c-d243-9db6-4c9e6ea96601, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:41578 deadline: 1689307519432, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=21c62941-a65c-d243-9db6-4c9e6ea96601, action=READ) 2023-07-14 04:04:19,432 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4998d032 to 127.0.0.1:50593 2023-07-14 04:04:19,432 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,433 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x59d8750a to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,437 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f8c44e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,439 DEBUG [hconnection-0x4689a00e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,440 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41586, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rouser' (table=21c62941-a65c-d243-9db6-4c9e6ea96601, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:41586 deadline: 1689307519442, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rouser' (table=21c62941-a65c-d243-9db6-4c9e6ea96601, action=READ) 2023-07-14 04:04:19,443 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59d8750a to 127.0.0.1:50593 2023-07-14 04:04:19,443 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,444 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x6135d1b4 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,447 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a37944c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,448 DEBUG [hconnection-0x41171baf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,449 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41596, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rwuser' (table=21c62941-a65c-d243-9db6-4c9e6ea96601, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:41596 deadline: 1689307519452, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rwuser' (table=21c62941-a65c-d243-9db6-4c9e6ea96601, action=READ) 2023-07-14 04:04:19,452 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6135d1b4 to 127.0.0.1:50593 2023-07-14 04:04:19,452 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,453 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x3b34a566 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,456 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42071bcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,458 DEBUG [hconnection-0x60829845-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,459 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41602, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,463 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b34a566 to 127.0.0.1:50593 2023-07-14 04:04:19,463 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,463 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x57cfcae8 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,466 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23fb20e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,467 DEBUG [hconnection-0x7f41d376-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,468 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41604, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:21c62941-a65c-d243-9db6-4c9e6ea96601, family=f1:cq, params=[table=default:21c62941-a65c-d243-9db6-4c9e6ea96601,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:41604 deadline: 1689307519471, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:21c62941-a65c-d243-9db6-4c9e6ea96601, family=f1:cq, params=[table=default:21c62941-a65c-d243-9db6-4c9e6ea96601,family=f1:cq],action=WRITE) 2023-07-14 04:04:19,472 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57cfcae8 to 127.0.0.1:50593 2023-07-14 04:04:19,472 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,472 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x62bb4921 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,477 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1310fc63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,478 DEBUG [hconnection-0x475cdc3a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,479 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41618, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rwuser, scope=default:21c62941-a65c-d243-9db6-4c9e6ea96601, family=f1:cq, params=[table=default:21c62941-a65c-d243-9db6-4c9e6ea96601,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:41618 deadline: 1689307519481, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rwuser, scope=default:21c62941-a65c-d243-9db6-4c9e6ea96601, family=f1:cq, params=[table=default:21c62941-a65c-d243-9db6-4c9e6ea96601,family=f1:cq],action=WRITE) 2023-07-14 04:04:19,482 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62bb4921 to 127.0.0.1:50593 2023-07-14 04:04:19,482 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,483 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x1e0f5a5b to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,488 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f93e8ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,490 DEBUG [hconnection-0x1ad9c1aa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,491 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41622, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:21c62941-a65c-d243-9db6-4c9e6ea96601, family=f1:cq, params=[table=default:21c62941-a65c-d243-9db6-4c9e6ea96601,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:41622 deadline: 1689307519493, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:21c62941-a65c-d243-9db6-4c9e6ea96601, family=f1:cq, params=[table=default:21c62941-a65c-d243-9db6-4c9e6ea96601,family=f1:cq],action=WRITE) 2023-07-14 04:04:19,494 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e0f5a5b to 127.0.0.1:50593 2023-07-14 04:04:19,494 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,495 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x6e07d14a to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,499 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a80b70d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,500 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:19,501 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:19,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x3210884e to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f201878, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,509 DEBUG [hconnection-0x100f8093-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,510 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3210884e to 127.0.0.1:50593 2023-07-14 04:04:19,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:19,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rouser,f1: R] 2023-07-14 04:04:19,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:19,517 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:19,518 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:19,521 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:19,521 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:19,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(235): Removed permission UserPermission: user=rouser, [TablePermission: table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1, qualifier=null, actions=READ] 2023-07-14 04:04:19,522 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:19,522 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:19,523 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:19,523 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e07d14a to 127.0.0.1:50593 2023-07-14 04:04:19,523 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,524 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:04:19,524 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x23e54a0f to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,527 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c4e6d19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,528 DEBUG [hconnection-0x4b12be6f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,530 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41644, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,532 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23e54a0f to 127.0.0.1:50593 2023-07-14 04:04:19,532 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,533 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x7091f6a3 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,537 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eaecf18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,538 DEBUG [hconnection-0x4fe32d03-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,539 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41660, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,541 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7091f6a3 to 127.0.0.1:50593 2023-07-14 04:04:19,541 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,542 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x64d55b3c to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,544 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3208e990, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,546 DEBUG [hconnection-0x7375fc73-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,546 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41672, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rouser' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:41672 deadline: 1689307519548, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rouser' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) 2023-07-14 04:04:19,549 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64d55b3c to 127.0.0.1:50593 2023-07-14 04:04:19,549 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,549 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x2810829e to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,552 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@745a758b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,555 DEBUG [hconnection-0x7f3b40f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,558 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41674, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:41674 deadline: 1689307519560, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) 2023-07-14 04:04:19,560 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2810829e to 127.0.0.1:50593 2023-07-14 04:04:19,561 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,561 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x24154cbe to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,566 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18cec4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,568 DEBUG [hconnection-0x490bdfe1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,569 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41678, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,571 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24154cbe to 127.0.0.1:50593 2023-07-14 04:04:19,571 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,572 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x06a50923 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,576 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11463ac1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,577 DEBUG [hconnection-0x62179c58-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,578 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41686, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,580 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06a50923 to 127.0.0.1:50593 2023-07-14 04:04:19,580 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,581 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x673c1ffb to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,584 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3997ba18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,587 DEBUG [hconnection-0x226d991d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,588 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41688, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:41688 deadline: 1689307519589, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) 2023-07-14 04:04:19,590 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x673c1ffb to 127.0.0.1:50593 2023-07-14 04:04:19,591 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,591 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x036b7ae2 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:19,599 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d80bee3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:19,601 DEBUG [hconnection-0x2f1422f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:19,602 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41694, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:19,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:19,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:41694 deadline: 1689307519604, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) 2023-07-14 04:04:19,606 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x036b7ae2 to 127.0.0.1:50593 2023-07-14 04:04:19,606 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:19,612 INFO [Listener at localhost/42791] client.HBaseAdmin$15(890): Started disable of fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:19,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:19,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=29, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:19,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307459626"}]},"ts":"1689307459626"} 2023-07-14 04:04:19,627 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=DISABLING in hbase:meta 2023-07-14 04:04:19,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=29 2023-07-14 04:04:19,629 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set fb8fce90-ed2c-98d2-b8ee-9608d264d688 to state=DISABLING 2023-07-14 04:04:19,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, UNASSIGN}, {pid=31, ppid=29, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, UNASSIGN}] 2023-07-14 04:04:19,632 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=31, ppid=29, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, UNASSIGN 2023-07-14 04:04:19,632 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=29, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, UNASSIGN 2023-07-14 04:04:19,633 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:19,633 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307459633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307459633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307459633"}]},"ts":"1689307459633"} 2023-07-14 04:04:19,633 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:19,634 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307459633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307459633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307459633"}]},"ts":"1689307459633"} 2023-07-14 04:04:19,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE; CloseRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:19,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; CloseRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:19,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=29 2023-07-14 04:04:19,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:19,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c4e06fb4ecdd3c332880d64437f3855, disabling compactions & flushes 2023-07-14 04:04:19,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:19,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:19,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. after waiting 0 ms 2023-07-14 04:04:19,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:19,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1c4e06fb4ecdd3c332880d64437f3855 1/1 column families, dataSize=64 B heapSize=464 B 2023-07-14 04:04:19,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=29 2023-07-14 04:04:20,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64 B at sequenceid=30011 (bloomFilter=true), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/.tmp/f1/44a0cfeec7e945deb838dc49a8348c05 2023-07-14 04:04:20,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/.tmp/f1/44a0cfeec7e945deb838dc49a8348c05 as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/44a0cfeec7e945deb838dc49a8348c05 2023-07-14 04:04:20,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/44a0cfeec7e945deb838dc49a8348c05, entries=2, sequenceid=30011, filesize=4.8 K 2023-07-14 04:04:20,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~64 B/64, heapSize ~448 B/448, currentSize=0 B/0 for 1c4e06fb4ecdd3c332880d64437f3855 in 431ms, sequenceid=30011, compaction requested=false 2023-07-14 04:04:20,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=29 2023-07-14 04:04:20,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/recovered.edits/30014.seqid, newMaxSeqId=30014, maxSeqId=1 2023-07-14 04:04:20,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:20,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:20,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c4e06fb4ecdd3c332880d64437f3855: 2023-07-14 04:04:20,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:20,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:20,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed1e85127c4d73d8edec872fdc80d2ed, disabling compactions & flushes 2023-07-14 04:04:20,237 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=CLOSED 2023-07-14 04:04:20,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:20,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:20,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. after waiting 0 ms 2023-07-14 04:04:20,238 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307460237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307460237"}]},"ts":"1689307460237"} 2023-07-14 04:04:20,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:20,240 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-07-14 04:04:20,240 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; CloseRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507 in 604 msec 2023-07-14 04:04:20,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, UNASSIGN in 609 msec 2023-07-14 04:04:20,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=1 2023-07-14 04:04:20,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:20,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:20,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed1e85127c4d73d8edec872fdc80d2ed: 2023-07-14 04:04:20,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:20,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=31 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=CLOSED 2023-07-14 04:04:20,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307460244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307460244"}]},"ts":"1689307460244"} 2023-07-14 04:04:20,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=31 2023-07-14 04:04:20,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=31, state=SUCCESS; CloseRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507 in 610 msec 2023-07-14 04:04:20,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-14 04:04:20,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, UNASSIGN in 616 msec 2023-07-14 04:04:20,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307460249"}]},"ts":"1689307460249"} 2023-07-14 04:04:20,250 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=DISABLED in hbase:meta 2023-07-14 04:04:20,252 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set fb8fce90-ed2c-98d2-b8ee-9608d264d688 to state=DISABLED 2023-07-14 04:04:20,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, state=SUCCESS; DisableTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 in 633 msec 2023-07-14 04:04:20,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=29 2023-07-14 04:04:20,732 INFO [Listener at localhost/42791] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, procId: 29 completed 2023-07-14 04:04:20,733 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x05bcff03 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:20,737 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x05bcff03] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31fb8bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:20,737 DEBUG [Listener at localhost/42791] client.ConnectionUtils(586): Start fetching master stub from registry 2023-07-14 04:04:20,738 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x05bcff03] client.AsyncConnectionImpl(289): The fetched master address is jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:04:20,738 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x05bcff03] client.ConnectionUtils(594): The fetched master stub is org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$Stub@7203c00 2023-07-14 04:04:20,741 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x05bcff03] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:20,742 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:20,752 DEBUG [RPCClient-NioEventLoopGroup-4-15] client.ConnectionUtils(586): Start fetching meta region location from registry 2023-07-14 04:04:20,754 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x05bcff03] client.ConnectionUtils(594): The fetched meta region location is [region=hbase:meta,,1.1588230740, hostname=jenkins-hbase4.apache.org,41323,1689307431507, seqNum=-1] 2023-07-14 04:04:20,754 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x05bcff03] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:20,756 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:20,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 ) 2023-07-14 04:04:20,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(880): Restore snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 as table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:20,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2023-07-14 04:04:20,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2023-07-14 04:04:21,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2023-07-14 04:04:21,197 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/.tabledesc/.tableinfo.0000000002 2023-07-14 04:04:21,198 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/.tabledesc/.tableinfo.0000000001 2023-07-14 04:04:21,198 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/.tabledesc/.tableinfo.0000000002 2023-07-14 04:04:21,199 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } 2023-07-14 04:04:21,203 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 2023-07-14 04:04:21,203 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:21,209 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 2 regions for table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:21,210 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:21,210 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:21,218 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/44a0cfeec7e945deb838dc49a8348c05 to hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/archive/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/44a0cfeec7e945deb838dc49a8348c05 2023-07-14 04:04:21,219 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 2023-07-14 04:04:21,220 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689307461220"}]},"ts":"9223372036854775807"} 2023-07-14 04:04:21,220 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689307461220"}]},"ts":"9223372036854775807"} 2023-07-14 04:04:21,222 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 04:04:21,223 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1c4e06fb4ecdd3c332880d64437f3855, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.', STARTKEY => '', ENDKEY => 's'}, {ENCODED => ed1e85127c4d73d8edec872fdc80d2ed, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.', STARTKEY => 's', ENDKEY => ''}] 2023-07-14 04:04:21,223 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307461221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307461221"}]},"ts":"1689307461221"} 2023-07-14 04:04:21,223 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307461221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307461221"}]},"ts":"1689307461221"} 2023-07-14 04:04:21,225 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 04:04:21,225 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 2 regions to Meta 2023-07-14 04:04:21,225 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 1c4e06fb4ecdd3c332880d64437f3855, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.', STARTKEY => '', ENDKEY => 's'}, {ENCODED => ed1e85127c4d73d8edec872fdc80d2ed, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.', STARTKEY => 's', ENDKEY => ''}] 2023-07-14 04:04:21,225 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } on table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 completed! 2023-07-14 04:04:21,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; RestoreSnapshotProcedure (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 ) in 456 msec 2023-07-14 04:04:21,370 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-14 04:04:21,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2023-07-14 04:04:21,404 INFO [Listener at localhost/42791] client.AsyncConnectionImpl(207): Connection has been closed by Listener at localhost/42791. 2023-07-14 04:04:21,405 DEBUG [Listener at localhost/42791] client.AsyncConnectionImpl(232): Call stack: at java.lang.Thread.getStackTrace(Thread.java:1564) at org.apache.hadoop.hbase.client.AsyncConnectionImpl.close(AsyncConnectionImpl.java:209) at org.apache.hadoop.hbase.client.TestSnapshotWithAclAsyncAdmin.restoreSnapshot(TestSnapshotWithAclAsyncAdmin.java:56) at org.apache.hadoop.hbase.client.SnapshotWithAclTestBase.testRestoreSnapshot(SnapshotWithAclTestBase.java:218) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-14 04:04:21,405 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:21,405 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05bcff03 to 127.0.0.1:50593 2023-07-14 04:04:21,406 INFO [Listener at localhost/42791] client.HBaseAdmin$14(830): Started enable of fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:21,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:21,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:21,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-14 04:04:21,419 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:21,419 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307461419"}]},"ts":"1689307461419"} 2023-07-14 04:04:21,420 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=ENABLING in hbase:meta 2023-07-14 04:04:21,423 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-07-14 04:04:21,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN}, {pid=37, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN}] 2023-07-14 04:04:21,425 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN 2023-07-14 04:04:21,425 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN 2023-07-14 04:04:21,426 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-14 04:04:21,426 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=37, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-14 04:04:21,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-14 04:04:21,577 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:21,577 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:21,577 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307461577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307461577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307461577"}]},"ts":"1689307461577"} 2023-07-14 04:04:21,577 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307461577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307461577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307461577"}]},"ts":"1689307461577"} 2023-07-14 04:04:21,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=36, state=RUNNABLE; OpenRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:21,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; OpenRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:21,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-14 04:04:21,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:21,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed1e85127c4d73d8edec872fdc80d2ed, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.', STARTKEY => 's', ENDKEY => ''} 2023-07-14 04:04:21,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. service=AccessControlService 2023-07-14 04:04:21,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:21,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table fb8fce90-ed2c-98d2-b8ee-9608d264d688 ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:21,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:21,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:21,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:21,737 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:21,738 DEBUG [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/f1 2023-07-14 04:04:21,738 DEBUG [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/f1 2023-07-14 04:04:21,739 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed1e85127c4d73d8edec872fdc80d2ed columnFamilyName f1 2023-07-14 04:04:21,740 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] regionserver.HStore(310): Store=ed1e85127c4d73d8edec872fdc80d2ed/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:21,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:21,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:21,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:21,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed1e85127c4d73d8edec872fdc80d2ed; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61256623, jitterRate=-0.0872051864862442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:21,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed1e85127c4d73d8edec872fdc80d2ed: 2023-07-14 04:04:21,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed., pid=39, masterSystemTime=1689307461730 2023-07-14 04:04:21,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:21,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:21,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:21,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c4e06fb4ecdd3c332880d64437f3855, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.', STARTKEY => '', ENDKEY => 's'} 2023-07-14 04:04:21,749 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=OPEN, openSeqNum=6, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:21,750 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307461749"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307461749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307461749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307461749"}]},"ts":"1689307461749"} 2023-07-14 04:04:21,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. service=AccessControlService 2023-07-14 04:04:21,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:21,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table fb8fce90-ed2c-98d2-b8ee-9608d264d688 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:21,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:21,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:21,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:21,752 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:21,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-14 04:04:21,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; OpenRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507 in 172 msec 2023-07-14 04:04:21,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN in 329 msec 2023-07-14 04:04:21,753 DEBUG [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1 2023-07-14 04:04:21,753 DEBUG [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1 2023-07-14 04:04:21,753 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c4e06fb4ecdd3c332880d64437f3855 columnFamilyName f1 2023-07-14 04:04:21,761 DEBUG [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] regionserver.HStore(539): loaded hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/8a409a7778f64cf6925b315907f6cd16 2023-07-14 04:04:21,761 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] regionserver.HStore(310): Store=1c4e06fb4ecdd3c332880d64437f3855/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:21,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:21,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:21,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:21,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c4e06fb4ecdd3c332880d64437f3855; next sequenceid=30015; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70049062, jitterRate=0.04381236433982849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:21,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c4e06fb4ecdd3c332880d64437f3855: 2023-07-14 04:04:21,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855., pid=38, masterSystemTime=1689307461730 2023-07-14 04:04:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:21,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:21,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=OPEN, openSeqNum=30015, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:21,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307461771"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307461771"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307461771"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307461771"}]},"ts":"1689307461771"} 2023-07-14 04:04:21,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-14 04:04:21,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; OpenRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507 in 193 msec 2023-07-14 04:04:21,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-07-14 04:04:21,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN in 351 msec 2023-07-14 04:04:21,776 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307461775"}]},"ts":"1689307461775"} 2023-07-14 04:04:21,776 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=ENABLED in hbase:meta 2023-07-14 04:04:21,778 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'fb8fce90-ed2c-98d2-b8ee-9608d264d688' was successfully enabled. 2023-07-14 04:04:21,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; EnableTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 in 367 msec 2023-07-14 04:04:22,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-14 04:04:22,023 INFO [Listener at localhost/42791] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, procId: 35 completed 2023-07-14 04:04:22,023 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x76b89e1b to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:22,027 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4249df43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:22,028 DEBUG [hconnection-0x70c56507-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:22,030 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38940, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:22,033 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76b89e1b to 127.0.0.1:50593 2023-07-14 04:04:22,033 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:22,034 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x1509093b to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:22,038 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ebfbbc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:22,039 DEBUG [hconnection-0x6165e27-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:22,041 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38942, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:22,044 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1509093b to 127.0.0.1:50593 2023-07-14 04:04:22,044 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:22,044 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x42317a68 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:22,047 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76e2e36f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:22,048 DEBUG [hconnection-0x2b133b03-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:22,049 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38954, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:22,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rouser' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:22,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:38954 deadline: 1689307522050, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rouser' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) 2023-07-14 04:04:22,052 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42317a68 to 127.0.0.1:50593 2023-07-14 04:04:22,052 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:22,052 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x6f5ec90b to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:22,061 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d273cc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:22,063 DEBUG [hconnection-0x7132b446-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:22,064 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38964, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:22,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:22,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:38964 deadline: 1689307522065, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) 2023-07-14 04:04:22,066 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f5ec90b to 127.0.0.1:50593 2023-07-14 04:04:22,066 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:22,067 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x37b4c602 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:22,069 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53c0d436, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:22,071 DEBUG [hconnection-0x6c9bbd9c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:22,072 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38966, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:22,075 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37b4c602 to 127.0.0.1:50593 2023-07-14 04:04:22,075 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:22,075 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x727db9e6 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:22,078 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43bb8d68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:22,079 DEBUG [hconnection-0x12d457b1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:22,080 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38968, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:22,082 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x727db9e6 to 127.0.0.1:50593 2023-07-14 04:04:22,082 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:22,082 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x7857ab49 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:22,085 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@488e022d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:22,086 DEBUG [hconnection-0x1c9cf374-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:22,087 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38970, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:22,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:22,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:38970 deadline: 1689307522089, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) 2023-07-14 04:04:22,090 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7857ab49 to 127.0.0.1:50593 2023-07-14 04:04:22,090 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:22,090 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4319f96e to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:22,093 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3865a52a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:22,094 DEBUG [hconnection-0x314bbfb6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:22,095 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38982, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:22,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:22,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:38982 deadline: 1689307522097, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) 2023-07-14 04:04:22,099 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4319f96e to 127.0.0.1:50593 2023-07-14 04:04:22,099 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:22,100 INFO [Listener at localhost/42791] client.HBaseAdmin$15(890): Started disable of fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:22,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:22,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=40, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:22,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=40 2023-07-14 04:04:22,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307462103"}]},"ts":"1689307462103"} 2023-07-14 04:04:22,104 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=DISABLING in hbase:meta 2023-07-14 04:04:22,106 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set fb8fce90-ed2c-98d2-b8ee-9608d264d688 to state=DISABLING 2023-07-14 04:04:22,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, UNASSIGN}, {pid=42, ppid=40, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, UNASSIGN}] 2023-07-14 04:04:22,107 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=40, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, UNASSIGN 2023-07-14 04:04:22,107 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=40, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, UNASSIGN 2023-07-14 04:04:22,108 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:22,108 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:22,108 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307462108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307462108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307462108"}]},"ts":"1689307462108"} 2023-07-14 04:04:22,108 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307462108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307462108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307462108"}]},"ts":"1689307462108"} 2023-07-14 04:04:22,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:22,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=40 2023-07-14 04:04:22,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:22,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c4e06fb4ecdd3c332880d64437f3855, disabling compactions & flushes 2023-07-14 04:04:22,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:22,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:22,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. after waiting 0 ms 2023-07-14 04:04:22,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:22,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1c4e06fb4ecdd3c332880d64437f3855 1/1 column families, dataSize=64 B heapSize=464 B 2023-07-14 04:04:22,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=40 2023-07-14 04:04:22,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64 B at sequenceid=30019 (bloomFilter=true), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/.tmp/f1/f780f79aa395444880975adadb62cf97 2023-07-14 04:04:22,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/.tmp/f1/f780f79aa395444880975adadb62cf97 as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/f780f79aa395444880975adadb62cf97 2023-07-14 04:04:22,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/f780f79aa395444880975adadb62cf97, entries=2, sequenceid=30019, filesize=4.8 K 2023-07-14 04:04:22,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~64 B/64, heapSize ~448 B/448, currentSize=0 B/0 for 1c4e06fb4ecdd3c332880d64437f3855 in 428ms, sequenceid=30019, compaction requested=false 2023-07-14 04:04:22,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/recovered.edits/30022.seqid, newMaxSeqId=30022, maxSeqId=30014 2023-07-14 04:04:22,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:22,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:22,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c4e06fb4ecdd3c332880d64437f3855: 2023-07-14 04:04:22,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:22,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:22,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed1e85127c4d73d8edec872fdc80d2ed, disabling compactions & flushes 2023-07-14 04:04:22,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:22,699 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=CLOSED 2023-07-14 04:04:22,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:22,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. after waiting 0 ms 2023-07-14 04:04:22,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:22,699 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307462699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307462699"}]},"ts":"1689307462699"} 2023-07-14 04:04:22,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=41 2023-07-14 04:04:22,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507 in 591 msec 2023-07-14 04:04:22,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, UNASSIGN in 595 msec 2023-07-14 04:04:22,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=5 2023-07-14 04:04:22,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:22,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:22,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed1e85127c4d73d8edec872fdc80d2ed: 2023-07-14 04:04:22,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:22,705 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=CLOSED 2023-07-14 04:04:22,705 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307462705"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307462705"}]},"ts":"1689307462705"} 2023-07-14 04:04:22,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=40 2023-07-14 04:04:22,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-14 04:04:22,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507 in 596 msec 2023-07-14 04:04:22,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=40 2023-07-14 04:04:22,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=40, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, UNASSIGN in 601 msec 2023-07-14 04:04:22,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307462709"}]},"ts":"1689307462709"} 2023-07-14 04:04:22,710 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=DISABLED in hbase:meta 2023-07-14 04:04:22,711 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set fb8fce90-ed2c-98d2-b8ee-9608d264d688 to state=DISABLED 2023-07-14 04:04:22,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, state=SUCCESS; DisableTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 in 612 msec 2023-07-14 04:04:23,029 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table '21c62941-a65c-d243-9db6-4c9e6ea96601' 2023-07-14 04:04:23,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=40 2023-07-14 04:04:23,207 INFO [Listener at localhost/42791] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, procId: 40 completed 2023-07-14 04:04:23,207 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x23630d81 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:23,211 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x23630d81] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@291ae925, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:23,212 DEBUG [Listener at localhost/42791] client.ConnectionUtils(586): Start fetching master stub from registry 2023-07-14 04:04:23,212 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x23630d81] client.AsyncConnectionImpl(289): The fetched master address is jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:04:23,212 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x23630d81] client.ConnectionUtils(594): The fetched master stub is org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$Stub@2d2578de 2023-07-14 04:04:23,212 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x23630d81] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:23,213 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:23,218 DEBUG [RPCClient-NioEventLoopGroup-4-9] client.ConnectionUtils(586): Start fetching meta region location from registry 2023-07-14 04:04:23,219 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x23630d81] client.ConnectionUtils(594): The fetched meta region location is [region=hbase:meta,,1.1588230740, hostname=jenkins-hbase4.apache.org,41323,1689307431507, seqNum=-1] 2023-07-14 04:04:23,220 DEBUG [ReadOnlyZKClient-127.0.0.1:50593@0x23630d81] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:23,220 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:23,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=45, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 ) 2023-07-14 04:04:23,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(880): Restore snapshot=b081a7b1-3d70-a2dc-4b32-3d1512f59205 as table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2023-07-14 04:04:23,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2023-07-14 04:04:23,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2023-07-14 04:04:23,647 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/.tabledesc/.tableinfo.0000000003 2023-07-14 04:04:23,649 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/.tabledesc/.tableinfo.0000000002 2023-07-14 04:04:23,649 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/.tabledesc/.tableinfo.0000000003 2023-07-14 04:04:23,650 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } 2023-07-14 04:04:23,653 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 2023-07-14 04:04:23,653 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,658 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 2 regions for table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,659 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:23,659 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:23,662 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/f780f79aa395444880975adadb62cf97 to hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/archive/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/f780f79aa395444880975adadb62cf97 2023-07-14 04:04:23,663 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 2023-07-14 04:04:23,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689307463663"}]},"ts":"9223372036854775807"} 2023-07-14 04:04:23,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689307463663"}]},"ts":"9223372036854775807"} 2023-07-14 04:04:23,665 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 04:04:23,665 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1c4e06fb4ecdd3c332880d64437f3855, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.', STARTKEY => '', ENDKEY => 's'}, {ENCODED => ed1e85127c4d73d8edec872fdc80d2ed, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.', STARTKEY => 's', ENDKEY => ''}] 2023-07-14 04:04:23,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307463664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307463664"}]},"ts":"1689307463664"} 2023-07-14 04:04:23,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307463664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307463664"}]},"ts":"1689307463664"} 2023-07-14 04:04:23,667 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 04:04:23,667 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 2 regions to Meta 2023-07-14 04:04:23,667 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 1c4e06fb4ecdd3c332880d64437f3855, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.', STARTKEY => '', ENDKEY => 's'}, {ENCODED => ed1e85127c4d73d8edec872fdc80d2ed, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.', STARTKEY => 's', ENDKEY => ''}] 2023-07-14 04:04:23,667 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=b081a7b1-3d70-a2dc-4b32-3d1512f59205 table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 type=FLUSH ttl=0 } on table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 completed! 2023-07-14 04:04:23,668 DEBUG [PEWorker-1] zookeeper.ReadOnlyZKClient(139): Connect 0x31ba3f13 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:23,673 DEBUG [PEWorker-1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63999c6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:23,674 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:23,675 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:23,675 DEBUG [PEWorker-1] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31ba3f13 to 127.0.0.1:50593 2023-07-14 04:04:23,676 DEBUG [PEWorker-1] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:23,676 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(841): Restore snapshot acl to table. snapshot: name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 , table: fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,676 DEBUG [PEWorker-1] zookeeper.ReadOnlyZKClient(139): Connect 0x0d0dca3b to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:23,679 DEBUG [PEWorker-1] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6daf2e2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:23,679 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:23,681 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:23,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x42c5326f to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:23,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e67bf90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:23,687 DEBUG [hconnection-0x22b2066d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:23,687 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:23,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42c5326f to 127.0.0.1:50593 2023-07-14 04:04:23,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:23,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:23,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:23,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey fb8fce90-ed2c-98d2-b8ee-9608d264d688 owner: RWXCA 2023-07-14 04:04:23,691 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:23,692 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:23,694 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,694 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:23,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:23,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x27791ce6 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:23,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@154ae70a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:23,700 DEBUG [hconnection-0x3ff40059-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:23,701 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:23,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27791ce6 to 127.0.0.1:50593 2023-07-14 04:04:23,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:23,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:23,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:23,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey fb8fce90-ed2c-98d2-b8ee-9608d264d688 rouser,f1: R 2023-07-14 04:04:23,705 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:23,705 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rouser,f1: R] 2023-07-14 04:04:23,705 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:23,707 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,707 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:23,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:23,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x3b9b7e7f to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:23,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2472579d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:23,719 DEBUG [hconnection-0x62498a51-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:23,720 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:23,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b9b7e7f to 127.0.0.1:50593 2023-07-14 04:04:23,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:23,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:23,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rouser,f1: R] 2023-07-14 04:04:23,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:23,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey fb8fce90-ed2c-98d2-b8ee-9608d264d688 rwuser,f1: RW 2023-07-14 04:04:23,723 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [owner: RWXCA] 2023-07-14 04:04:23,724 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rouser,f1: R] 2023-07-14 04:04:23,724 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[fb8fce90-ed2c-98d2-b8ee-9608d264d688], kv [rwuser,f1: RW] 2023-07-14 04:04:23,726 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,726 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,726 INFO [PEWorker-1] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:23,727 DEBUG [PEWorker-1] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d0dca3b to 127.0.0.1:50593 2023-07-14 04:04:23,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:23,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:23,727 DEBUG [PEWorker-1] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:23,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, state=SUCCESS; RestoreSnapshotProcedure (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 snapshot=name: "b081a7b1-3d70-a2dc-4b32-3d1512f59205" table: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" creation_time: 1689307450441 type: FLUSH version: 2 owner: "jenkins" users_and_permissions { user_permissions { user: "owner" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } action: READ action: WRITE action: EXEC action: CREATE action: ADMIN } } } user_permissions { user: "rouser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ } } } user_permissions { user: "rwuser" permissions { type: Table table_permission { table_name { namespace: "default" qualifier: "fb8fce90-ed2c-98d2-b8ee-9608d264d688" } family: "f1" action: READ action: WRITE } } } } ttl: 0 ) in 498 msec 2023-07-14 04:04:23,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2023-07-14 04:04:23,854 INFO [Listener at localhost/42791] client.AsyncConnectionImpl(207): Connection has been closed by Listener at localhost/42791. 2023-07-14 04:04:23,854 DEBUG [Listener at localhost/42791] client.AsyncConnectionImpl(232): Call stack: at java.lang.Thread.getStackTrace(Thread.java:1564) at org.apache.hadoop.hbase.client.AsyncConnectionImpl.close(AsyncConnectionImpl.java:209) at org.apache.hadoop.hbase.client.TestSnapshotWithAclAsyncAdmin.restoreSnapshot(TestSnapshotWithAclAsyncAdmin.java:56) at org.apache.hadoop.hbase.client.SnapshotWithAclTestBase.testRestoreSnapshot(SnapshotWithAclTestBase.java:227) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-14 04:04:23,854 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:23,855 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23630d81 to 127.0.0.1:50593 2023-07-14 04:04:23,855 INFO [Listener at localhost/42791] client.HBaseAdmin$14(830): Started enable of fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=46, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=46 2023-07-14 04:04:23,858 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table fb8fce90-ed2c-98d2-b8ee-9608d264d688 2023-07-14 04:04:23,859 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307463858"}]},"ts":"1689307463858"} 2023-07-14 04:04:23,859 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=ENABLING in hbase:meta 2023-07-14 04:04:23,863 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-07-14 04:04:23,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=46, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN}, {pid=48, ppid=46, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN}] 2023-07-14 04:04:23,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=47, ppid=46, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN 2023-07-14 04:04:23,864 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=48, ppid=46, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN 2023-07-14 04:04:23,864 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=47, ppid=46, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-14 04:04:23,865 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=48, ppid=46, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-14 04:04:23,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=46 2023-07-14 04:04:24,016 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=48 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:24,016 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=47 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:24,016 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307464016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307464016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307464016"}]},"ts":"1689307464016"} 2023-07-14 04:04:24,016 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307464016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307464016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307464016"}]},"ts":"1689307464016"} 2023-07-14 04:04:24,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=47, state=RUNNABLE; OpenRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:24,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=48, state=RUNNABLE; OpenRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:24,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=46 2023-07-14 04:04:24,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:24,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c4e06fb4ecdd3c332880d64437f3855, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.', STARTKEY => '', ENDKEY => 's'} 2023-07-14 04:04:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. service=AccessControlService 2023-07-14 04:04:24,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table fb8fce90-ed2c-98d2-b8ee-9608d264d688 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:24,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:24,174 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:24,176 DEBUG [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1 2023-07-14 04:04:24,176 DEBUG [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1 2023-07-14 04:04:24,176 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c4e06fb4ecdd3c332880d64437f3855 columnFamilyName f1 2023-07-14 04:04:24,183 DEBUG [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] regionserver.HStore(539): loaded hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/8a409a7778f64cf6925b315907f6cd16 2023-07-14 04:04:24,183 INFO [StoreOpener-1c4e06fb4ecdd3c332880d64437f3855-1] regionserver.HStore(310): Store=1c4e06fb4ecdd3c332880d64437f3855/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:24,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:24,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:24,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:24,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c4e06fb4ecdd3c332880d64437f3855; next sequenceid=30023; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65153380, jitterRate=-0.02913898229598999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:24,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c4e06fb4ecdd3c332880d64437f3855: 2023-07-14 04:04:24,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855., pid=49, masterSystemTime=1689307464169 2023-07-14 04:04:24,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:24,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:24,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:24,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed1e85127c4d73d8edec872fdc80d2ed, NAME => 'fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.', STARTKEY => 's', ENDKEY => ''} 2023-07-14 04:04:24,192 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=47 updating hbase:meta row=1c4e06fb4ecdd3c332880d64437f3855, regionState=OPEN, openSeqNum=30023, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:24,192 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307464192"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307464192"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307464192"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307464192"}]},"ts":"1689307464192"} 2023-07-14 04:04:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. service=AccessControlService 2023-07-14 04:04:24,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table fb8fce90-ed2c-98d2-b8ee-9608d264d688 ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:24,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=47 2023-07-14 04:04:24,195 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:24,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=47, state=SUCCESS; OpenRegionProcedure 1c4e06fb4ecdd3c332880d64437f3855, server=jenkins-hbase4.apache.org,41323,1689307431507 in 176 msec 2023-07-14 04:04:24,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=46, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=1c4e06fb4ecdd3c332880d64437f3855, ASSIGN in 332 msec 2023-07-14 04:04:24,196 DEBUG [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/f1 2023-07-14 04:04:24,196 DEBUG [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/f1 2023-07-14 04:04:24,197 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed1e85127c4d73d8edec872fdc80d2ed columnFamilyName f1 2023-07-14 04:04:24,198 INFO [StoreOpener-ed1e85127c4d73d8edec872fdc80d2ed-1] regionserver.HStore(310): Store=ed1e85127c4d73d8edec872fdc80d2ed/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:24,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:24,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:24,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:24,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed1e85127c4d73d8edec872fdc80d2ed; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69485221, jitterRate=0.035410478711128235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:24,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed1e85127c4d73d8edec872fdc80d2ed: 2023-07-14 04:04:24,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed., pid=50, masterSystemTime=1689307464169 2023-07-14 04:04:24,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:24,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:24,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=48 updating hbase:meta row=ed1e85127c4d73d8edec872fdc80d2ed, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:24,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307464206"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307464206"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307464206"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307464206"}]},"ts":"1689307464206"} 2023-07-14 04:04:24,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=48 2023-07-14 04:04:24,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=48, state=SUCCESS; OpenRegionProcedure ed1e85127c4d73d8edec872fdc80d2ed, server=jenkins-hbase4.apache.org,41323,1689307431507 in 190 msec 2023-07-14 04:04:24,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=46 2023-07-14 04:04:24,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=46, state=SUCCESS; TransitRegionStateProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, region=ed1e85127c4d73d8edec872fdc80d2ed, ASSIGN in 346 msec 2023-07-14 04:04:24,211 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"fb8fce90-ed2c-98d2-b8ee-9608d264d688","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307464211"}]},"ts":"1689307464211"} 2023-07-14 04:04:24,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=fb8fce90-ed2c-98d2-b8ee-9608d264d688, state=ENABLED in hbase:meta 2023-07-14 04:04:24,213 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'fb8fce90-ed2c-98d2-b8ee-9608d264d688' was successfully enabled. 2023-07-14 04:04:24,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, state=SUCCESS; EnableTableProcedure table=fb8fce90-ed2c-98d2-b8ee-9608d264d688 in 358 msec 2023-07-14 04:04:24,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=46 2023-07-14 04:04:24,461 INFO [Listener at localhost/42791] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, procId: 46 completed 2023-07-14 04:04:24,461 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4f39a054 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:24,464 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52b152ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:24,466 DEBUG [hconnection-0x31fc1c4a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:24,467 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39044, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:24,470 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f39a054 to 127.0.0.1:50593 2023-07-14 04:04:24,470 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:24,471 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x500f3737 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:24,476 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c07f30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:24,477 DEBUG [hconnection-0x4bc52861-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:24,478 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39060, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:24,481 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x500f3737 to 127.0.0.1:50593 2023-07-14 04:04:24,481 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:24,481 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x6146a7fb to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:24,483 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3221d92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:24,484 DEBUG [hconnection-0x5b75276c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:24,485 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39064, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:24,487 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6146a7fb to 127.0.0.1:50593 2023-07-14 04:04:24,487 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:24,488 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x149a41f2 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:24,491 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66265a4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:24,495 DEBUG [hconnection-0x6538b58c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:24,495 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39068, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:24,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) at org.apache.hadoop.hbase.security.access.AccessController.internalPreRead(AccessController.java:1351) at org.apache.hadoop.hbase.security.access.AccessController.preGetOp(AccessController.java:1358) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:830) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$19.call(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preGet(RegionCoprocessorHost.java:827) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2604) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2540) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44992) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:24,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Get size: 140 connection: 172.31.14.131:39068 deadline: 1689307524497, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (table=fb8fce90-ed2c-98d2-b8ee-9608d264d688, action=READ) 2023-07-14 04:04:24,497 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x149a41f2 to 127.0.0.1:50593 2023-07-14 04:04:24,498 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:24,498 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4823e6ad to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:24,500 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6817bef0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:24,502 DEBUG [hconnection-0x30bfb712-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:24,503 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39072, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=ClientService 2023-07-14 04:04:24,505 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4823e6ad to 127.0.0.1:50593 2023-07-14 04:04:24,505 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:24,505 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x3617d68e to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:24,511 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bdde079, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:24,512 DEBUG [hconnection-0x53c20acb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:24,513 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39086, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:24,515 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3617d68e to 127.0.0.1:50593 2023-07-14 04:04:24,515 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:24,516 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x3c53c5df to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:24,518 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f0404cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:24,519 DEBUG [hconnection-0x4e3abb30-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:24,520 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39088, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=ClientService 2023-07-14 04:04:24,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:24,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:39088 deadline: 1689307524521, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) 2023-07-14 04:04:24,522 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c53c5df to 127.0.0.1:50593 2023-07-14 04:04:24,522 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:24,522 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x5254d325 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:24,525 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49ac1164, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:24,526 DEBUG [hconnection-0x50ca1604-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:24,527 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39094, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=ClientService 2023-07-14 04:04:24,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) at org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController.java:1388) at org.apache.hadoop.hbase.coprocessor.RegionObserver.prePut(RegionObserver.java:413) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:907) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:904) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.callPreMutateCPHook(HRegion.java:4161) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.access$800(HRegion.java:3611) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation$1.visit(HRegion.java:3686) at org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3219) at org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.checkAndPrepare(HRegion.java:3675) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4448) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4381) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4857) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4851) at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:4847) at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:3159) at org.apache.hadoop.hbase.regionserver.RSRpcServices.put(RSRpcServices.java:3006) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2969) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44994) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:24,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41323] ipc.CallRunner(144): callId: 1 service: ClientService methodName: Mutate size: 162 connection: 172.31.14.131:39094 deadline: 1689307524528, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688, family=f1:cq, params=[table=default:fb8fce90-ed2c-98d2-b8ee-9608d264d688,family=f1:cq],action=WRITE) 2023-07-14 04:04:24,529 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5254d325 to 127.0.0.1:50593 2023-07-14 04:04:24,530 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:24,551 INFO [Listener at localhost/42791] hbase.ResourceChecker(175): after: client.TestSnapshotWithAclAsyncAdmin#testRestoreSnapshot Thread=258 (was 215) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/cluster_b593e329-f19a-8822-21e5-4d9c97e93cbb/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x6146a7fb-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1190805740_17 at /127.0.0.1:58146 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4823e6ad-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x6146a7fb java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x6146a7fb-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x3c53c5df java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x3c53c5df-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1450212642_17 at /127.0.0.1:45328 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x500f3737-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x149a41f2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4f39a054-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x500f3737 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4f39a054 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x149a41f2-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x3c53c5df-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4f39a054-SendThread(127.0.0.1:50593) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x3617d68e-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x500f3737-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x3617d68e-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x149a41f2 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x5254d325-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/cluster_b593e329-f19a-8822-21e5-4d9c97e93cbb/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12bb43db-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x3617d68e java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4823e6ad java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x5254d325-SendThread(127.0.0.1:50593) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x5254d325 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4823e6ad-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12bb43db-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async-Client-Retry-Timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=525 (was 473) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=113 (was 48) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=6495 (was 6837) 2023-07-14 04:04:24,564 INFO [Listener at localhost/42791] hbase.ResourceChecker(147): before: client.TestSnapshotWithAclAsyncAdmin#testDeleteSnapshot Thread=258, OpenFileDescriptor=525, MaxFileDescriptor=60000, SystemLoadAverage=113, ProcessCount=170, AvailableMemoryMB=6495 2023-07-14 04:04:24,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create '8249d97d-3098-44b7-b98d-7a9fbec9db7c', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 04:04:24,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c 2023-07-14 04:04:24,568 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=51, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 04:04:24,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "8249d97d-3098-44b7-b98d-7a9fbec9db7c" procId is: 51 2023-07-14 04:04:24,569 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=51, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 04:04:24,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 04:04:24,571 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:24,571 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:24,572 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24 empty. 2023-07-14 04:04:24,572 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5 empty. 2023-07-14 04:04:24,572 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:24,572 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:24,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived 8249d97d-3098-44b7-b98d-7a9fbec9db7c regions 2023-07-14 04:04:24,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 04:04:24,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 04:04:24,984 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/.tabledesc/.tableinfo.0000000001 2023-07-14 04:04:24,986 INFO [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(7675): creating {ENCODED => b8c757dd8faaa8b52119b6b735fe8d24, NAME => '8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24.', STARTKEY => '', ENDKEY => 's'}, tableDescriptor='8249d97d-3098-44b7-b98d-7a9fbec9db7c', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:04:24,986 INFO [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(7675): creating {ENCODED => b80b4696e06939180eb5441824006cb5, NAME => '8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5.', STARTKEY => 's', ENDKEY => ''}, tableDescriptor='8249d97d-3098-44b7-b98d-7a9fbec9db7c', {TABLE_ATTRIBUTES => {METADATA => {'OWNER' => 'owner'}}}, {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '100', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.tmp 2023-07-14 04:04:25,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 04:04:25,397 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(866): Instantiated 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:25,397 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(866): Instantiated 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:25,397 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(1604): Closing b8c757dd8faaa8b52119b6b735fe8d24, disabling compactions & flushes 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(1604): Closing b80b4696e06939180eb5441824006cb5, disabling compactions & flushes 2023-07-14 04:04:25,398 INFO [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(1626): Closing region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:25,398 INFO [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(1626): Closing region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(1714): Acquired close lock on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. after waiting 0 ms 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(1724): Updates disabled for region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(1714): Acquired close lock on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. after waiting 0 ms 2023-07-14 04:04:25,398 INFO [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(1838): Closed 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(1724): Updates disabled for region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-1] regionserver.HRegion(1558): Region close journal for b80b4696e06939180eb5441824006cb5: 2023-07-14 04:04:25,398 INFO [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(1838): Closed 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:25,398 DEBUG [RegionOpenAndInit-8249d97d-3098-44b7-b98d-7a9fbec9db7c-pool-0] regionserver.HRegion(1558): Region close journal for b8c757dd8faaa8b52119b6b735fe8d24: 2023-07-14 04:04:25,401 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=51, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 04:04:25,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307465401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307465401"}]},"ts":"1689307465401"} 2023-07-14 04:04:25,402 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307465401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689307465401"}]},"ts":"1689307465401"} 2023-07-14 04:04:25,403 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 04:04:25,404 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=51, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 04:04:25,404 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"8249d97d-3098-44b7-b98d-7a9fbec9db7c","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307465404"}]},"ts":"1689307465404"} 2023-07-14 04:04:25,405 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, state=ENABLING in hbase:meta 2023-07-14 04:04:25,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c, region=b8c757dd8faaa8b52119b6b735fe8d24, ASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c, region=b80b4696e06939180eb5441824006cb5, ASSIGN}] 2023-07-14 04:04:25,410 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c, region=b80b4696e06939180eb5441824006cb5, ASSIGN 2023-07-14 04:04:25,410 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c, region=b8c757dd8faaa8b52119b6b735fe8d24, ASSIGN 2023-07-14 04:04:25,411 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c, region=b80b4696e06939180eb5441824006cb5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:04:25,411 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c, region=b8c757dd8faaa8b52119b6b735fe8d24, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41323,1689307431507; forceNewPlan=false, retain=false 2023-07-14 04:04:25,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b80b4696e06939180eb5441824006cb5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:25,562 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b8c757dd8faaa8b52119b6b735fe8d24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:25,562 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307465562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307465562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307465562"}]},"ts":"1689307465562"} 2023-07-14 04:04:25,562 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307465562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689307465562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689307465562"}]},"ts":"1689307465562"} 2023-07-14 04:04:25,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; OpenRegionProcedure b80b4696e06939180eb5441824006cb5, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:25,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; OpenRegionProcedure b8c757dd8faaa8b52119b6b735fe8d24, server=jenkins-hbase4.apache.org,41323,1689307431507}] 2023-07-14 04:04:25,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 04:04:25,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:25,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b8c757dd8faaa8b52119b6b735fe8d24, NAME => '8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24.', STARTKEY => '', ENDKEY => 's'} 2023-07-14 04:04:25,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. service=AccessControlService 2023-07-14 04:04:25,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:25,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table 8249d97d-3098-44b7-b98d-7a9fbec9db7c b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:25,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:25,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:25,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:25,721 INFO [StoreOpener-b8c757dd8faaa8b52119b6b735fe8d24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:25,722 DEBUG [StoreOpener-b8c757dd8faaa8b52119b6b735fe8d24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24/f1 2023-07-14 04:04:25,723 DEBUG [StoreOpener-b8c757dd8faaa8b52119b6b735fe8d24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24/f1 2023-07-14 04:04:25,723 INFO [StoreOpener-b8c757dd8faaa8b52119b6b735fe8d24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8c757dd8faaa8b52119b6b735fe8d24 columnFamilyName f1 2023-07-14 04:04:25,724 INFO [StoreOpener-b8c757dd8faaa8b52119b6b735fe8d24-1] regionserver.HStore(310): Store=b8c757dd8faaa8b52119b6b735fe8d24/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:25,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:25,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:25,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:25,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:04:25,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b8c757dd8faaa8b52119b6b735fe8d24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64600965, jitterRate=-0.03737060725688934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:25,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b8c757dd8faaa8b52119b6b735fe8d24: 2023-07-14 04:04:25,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24., pid=55, masterSystemTime=1689307465715 2023-07-14 04:04:25,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:25,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:25,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:25,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b80b4696e06939180eb5441824006cb5, NAME => '8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5.', STARTKEY => 's', ENDKEY => ''} 2023-07-14 04:04:25,733 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b8c757dd8faaa8b52119b6b735fe8d24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:25,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. service=AccessControlService 2023-07-14 04:04:25,733 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307465733"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307465733"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307465733"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307465733"}]},"ts":"1689307465733"} 2023-07-14 04:04:25,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 04:04:25,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table 8249d97d-3098-44b7-b98d-7a9fbec9db7c b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:25,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 04:04:25,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:25,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:25,735 INFO [StoreOpener-b80b4696e06939180eb5441824006cb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:25,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-14 04:04:25,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; OpenRegionProcedure b8c757dd8faaa8b52119b6b735fe8d24, server=jenkins-hbase4.apache.org,41323,1689307431507 in 170 msec 2023-07-14 04:04:25,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c, region=b8c757dd8faaa8b52119b6b735fe8d24, ASSIGN in 326 msec 2023-07-14 04:04:25,736 DEBUG [StoreOpener-b80b4696e06939180eb5441824006cb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5/f1 2023-07-14 04:04:25,736 DEBUG [StoreOpener-b80b4696e06939180eb5441824006cb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5/f1 2023-07-14 04:04:25,737 INFO [StoreOpener-b80b4696e06939180eb5441824006cb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b80b4696e06939180eb5441824006cb5 columnFamilyName f1 2023-07-14 04:04:25,737 INFO [StoreOpener-b80b4696e06939180eb5441824006cb5-1] regionserver.HStore(310): Store=b80b4696e06939180eb5441824006cb5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 04:04:25,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:25,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:25,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:25,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 04:04:25,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b80b4696e06939180eb5441824006cb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62783797, jitterRate=-0.0644485205411911}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 04:04:25,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b80b4696e06939180eb5441824006cb5: 2023-07-14 04:04:25,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5., pid=54, masterSystemTime=1689307465715 2023-07-14 04:04:25,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:25,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:25,745 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b80b4696e06939180eb5441824006cb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:25,745 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689307465745"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689307465745"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689307465745"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689307465745"}]},"ts":"1689307465745"} 2023-07-14 04:04:25,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-14 04:04:25,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; OpenRegionProcedure b80b4696e06939180eb5441824006cb5, server=jenkins-hbase4.apache.org,41323,1689307431507 in 182 msec 2023-07-14 04:04:25,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-14 04:04:25,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c, region=b80b4696e06939180eb5441824006cb5, ASSIGN in 339 msec 2023-07-14 04:04:25,749 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=51, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 04:04:25,749 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"8249d97d-3098-44b7-b98d-7a9fbec9db7c","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689307465749"}]},"ts":"1689307465749"} 2023-07-14 04:04:25,750 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, state=ENABLED in hbase:meta 2023-07-14 04:04:25,752 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=51, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 04:04:25,752 WARN [PEWorker-1] access.AccessController(784): Not adding owner permission for table 8249d97d-3098-44b7-b98d-7a9fbec9db7c. hbase:acl is not yet created. AccessController should be configured as the first Coprocessor 2023-07-14 04:04:25,752 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey 8249d97d-3098-44b7-b98d-7a9fbec9db7c owner: RWXCA 2023-07-14 04:04:25,753 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [owner: RWXCA] 2023-07-14 04:04:25,755 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 04:04:25,755 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 04:04:25,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:25,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from fb8fce90-ed2c-98d2-b8ee-9608d264d688 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688 \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$fb8fce90-ed2c-98d2-b8ee-9608d264d688\x12\x02f1 \x00 \x01 2023-07-14 04:04:25,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; CreateTableProcedure table=8249d97d-3098-44b7-b98d-7a9fbec9db7c in 1.1910 sec 2023-07-14 04:04:25,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 21c62941-a65c-d243-9db6-4c9e6ea96601 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$21c62941-a65c-d243-9db6-4c9e6ea96601 \x00 \x01 \x02 \x03 \x04 2023-07-14 04:04:25,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 21c62941-a65c-d243-9db6-4c9e6ea96601 with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$21c62941-a65c-d243-9db6-4c9e6ea96601 \x00 \x01 \x02 \x03 \x04 2023-07-14 04:04:25,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 \x01 2023-07-14 04:04:25,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf\x12\x02f1 \x00 \x01 2023-07-14 04:04:25,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 8249d97d-3098-44b7-b98d-7a9fbec9db7c with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c \x00 \x01 \x02 \x03 \x04 2023-07-14 04:04:25,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 8249d97d-3098-44b7-b98d-7a9fbec9db7c with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c \x00 \x01 \x02 \x03 \x04 2023-07-14 04:04:26,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 04:04:26,674 INFO [Listener at localhost/42791] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:8249d97d-3098-44b7-b98d-7a9fbec9db7c, procId: 51 completed 2023-07-14 04:04:26,675 DEBUG [Listener at localhost/42791] hbase.HBaseTestingUtility(3430): Waiting until all regions of table 8249d97d-3098-44b7-b98d-7a9fbec9db7c get assigned. Timeout = 60000ms 2023-07-14 04:04:26,675 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:04:26,677 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(3484): All regions for table 8249d97d-3098-44b7-b98d-7a9fbec9db7c assigned to meta. Checking AM states. 2023-07-14 04:04:26,677 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:04:26,678 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(3504): All regions for table 8249d97d-3098-44b7-b98d-7a9fbec9db7c assigned. 2023-07-14 04:04:26,678 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:04:26,681 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4ac1f82e to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:26,684 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788c4cf9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:26,684 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:26,685 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:26,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey 8249d97d-3098-44b7-b98d-7a9fbec9db7c rwuser,f1: RW 2023-07-14 04:04:26,687 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [owner: RWXCA] 2023-07-14 04:04:26,687 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rwuser,f1: RW] 2023-07-14 04:04:26,691 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/8249d97d-3098-44b7-b98d-7a9fbec9db7c 2023-07-14 04:04:26,691 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/8249d97d-3098-44b7-b98d-7a9fbec9db7c 2023-07-14 04:04:26,691 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:26,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 8249d97d-3098-44b7-b98d-7a9fbec9db7c with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c \x00 \x01 \x02 \x03 \x04\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c\x12\x02f1 \x00 \x01 2023-07-14 04:04:26,691 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ac1f82e to 127.0.0.1:50593 2023-07-14 04:04:26,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 8249d97d-3098-44b7-b98d-7a9fbec9db7c with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c \x00 \x01 \x02 \x03 \x04\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c\x12\x02f1 \x00 \x01 2023-07-14 04:04:26,691 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:26,692 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:04:26,692 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x2a2ce6a4 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:26,695 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a20b7f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:26,695 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:26,696 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 04:04:26,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(175): Writing permission with rowKey 8249d97d-3098-44b7-b98d-7a9fbec9db7c rouser,f1: R 2023-07-14 04:04:26,698 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [owner: RWXCA] 2023-07-14 04:04:26,698 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rouser,f1: R] 2023-07-14 04:04:26,698 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41323] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rwuser,f1: RW] 2023-07-14 04:04:26,701 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/8249d97d-3098-44b7-b98d-7a9fbec9db7c 2023-07-14 04:04:26,701 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/8249d97d-3098-44b7-b98d-7a9fbec9db7c 2023-07-14 04:04:26,701 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:26,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 8249d97d-3098-44b7-b98d-7a9fbec9db7c with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c\x12\x02f1 \x00 \x01 2023-07-14 04:04:26,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from 8249d97d-3098-44b7-b98d-7a9fbec9db7c with data PBUF\x0AH\x0A\x05owner\x12?\x08\x03";\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c \x00 \x01 \x02 \x03 \x04\x0AE\x0A\x06rouser\x12;\x08\x03"7\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c\x12\x02f1 \x00\x0AG\x0A\x06rwuser\x12=\x08\x03"9\x0A/\x0A\x07default\x12$8249d97d-3098-44b7-b98d-7a9fbec9db7c\x12\x02f1 \x00 \x01 2023-07-14 04:04:26,702 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a2ce6a4 to 127.0.0.1:50593 2023-07-14 04:04:26,702 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:26,702 INFO [Listener at localhost/42791] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 04:04:26,703 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4f652e17 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:26,705 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55945886, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:26,706 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:26,707 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40802, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=MasterService 2023-07-14 04:04:26,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1583): Client=owner//172.31.14.131 snapshot request for:{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } 2023-07-14 04:04:26,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689307466708 (current time:1689307466708). 2023-07-14 04:04:26,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 04:04:26,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x703c51c1 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:26,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@193af0d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:26,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:26,714 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:26,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x703c51c1 to 127.0.0.1:50593 2023-07-14 04:04:26,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:26,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x1f539f16 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:26,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@df36764, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:26,719 DEBUG [hconnection-0x4301ba7a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:26,720 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:26,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f539f16 to 127.0.0.1:50593 2023-07-14 04:04:26,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:26,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [owner: RWXCA] 2023-07-14 04:04:26,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rouser,f1: R] 2023-07-14 04:04:26,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rwuser,f1: RW] 2023-07-14 04:04:26,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 04:04:26,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } 2023-07-14 04:04:26,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=EXCLUSIVE 2023-07-14 04:04:26,725 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=56, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=EXCLUSIVE 2023-07-14 04:04:26,726 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=56, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=EXCLUSIVE; timeout=600000, timestamp=1689308066726 2023-07-14 04:04:26,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(653): Started snapshot: { ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } 2023-07-14 04:04:26,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot 7175ea07-1865-bab9-dfe2-0c4877158581 C_M_SNAPSHOT_TABLE on table 8249d97d-3098-44b7-b98d-7a9fbec9db7c 2023-07-14 04:04:26,727 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 04:04:26,727 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 04:04:26,727 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=56, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=EXCLUSIVE 2023-07-14 04:04:26,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=SHARED 2023-07-14 04:04:26,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=EXCLUSIVE in 3 msec 2023-07-14 04:04:26,728 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=57, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=SHARED 2023-07-14 04:04:26,729 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=57, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=SHARED; timeout=600000, timestamp=1689308066729 2023-07-14 04:04:26,827 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 04:04:26,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } is done 2023-07-14 04:04:26,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:26,829 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 04:04:27,029 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 04:04:27,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } is done 2023-07-14 04:04:27,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:27,030 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 04:04:27,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure 7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,138 INFO [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure '7175ea07-1865-bab9-dfe2-0c4877158581' 2023-07-14 04:04:27,138 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 04:04:27,138 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure '7175ea07-1865-bab9-dfe2-0c4877158581' starting 'acquire' 2023-07-14 04:04:27,138 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure '7175ea07-1865-bab9-dfe2-0c4877158581', kicking off acquire phase on members. 2023-07-14 04:04:27,139 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,139 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,140 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,140 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 04:04:27,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 04:04:27,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 04:04:27,140 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,140 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 04:04:27,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 321 2023-07-14 04:04:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,141 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot 7175ea07-1865-bab9-dfe2-0c4877158581 from table 8249d97d-3098-44b7-b98d-7a9fbec9db7c type FLUSH 2023-07-14 04:04:27,141 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,142 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure '7175ea07-1865-bab9-dfe2-0c4877158581' with timeout 300000ms 2023-07-14 04:04:27,142 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 04:04:27,142 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure '7175ea07-1865-bab9-dfe2-0c4877158581' starting 'acquire' stage 2023-07-14 04:04:27,142 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure '7175ea07-1865-bab9-dfe2-0c4877158581' locally acquired 2023-07-14 04:04:27,142 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41323,1689307431507' joining acquired barrier for procedure (7175ea07-1865-bab9-dfe2-0c4877158581) in zk 2023-07-14 04:04:27,144 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,144 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 04:04:27,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 04:04:27,144 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 04:04:27,145 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure '7175ea07-1865-bab9-dfe2-0c4877158581' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 04:04:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 04:04:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 04:04:27,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41323,1689307431507' joining acquired barrier for procedure '7175ea07-1865-bab9-dfe2-0c4877158581' on coordinator 2023-07-14 04:04:27,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cff4583[Count = 0] remaining members to acquire global barrier 2023-07-14 04:04:27,146 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure '7175ea07-1865-bab9-dfe2-0c4877158581' starting 'in-barrier' execution. 2023-07-14 04:04:27,146 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,148 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,148 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure '7175ea07-1865-bab9-dfe2-0c4877158581' received 'reached' from coordinator. 2023-07-14 04:04:27,148 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,148 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 04:04:27,149 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:27,149 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 2 regions 2023-07-14 04:04:27,149 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. started... 2023-07-14 04:04:27,149 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:27,149 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 04:04:27,149 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. started... 2023-07-14 04:04:27,149 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b80b4696e06939180eb5441824006cb5: 2023-07-14 04:04:27,150 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for b8c757dd8faaa8b52119b6b735fe8d24: 2023-07-14 04:04:27,150 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing '8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5.' region-info for snapshot=7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,150 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 04:04:27,150 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing '8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24.' region-info for snapshot=7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,150 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 04:04:27,150 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 04:04:27,150 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 04:04:27,237 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-14 04:04:27,331 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 04:04:27,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } is done 2023-07-14 04:04:27,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:27,332 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 04:04:27,562 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. completed. 2023-07-14 04:04:27,562 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:27,562 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/2 local region snapshots. 2023-07-14 04:04:27,562 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. completed. 2023-07-14 04:04:27,562 DEBUG [rs(jenkins-hbase4.apache.org,41323,1689307431507)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:27,563 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/2 local region snapshots. 2023-07-14 04:04:27,563 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 2 local region snapshots. 2023-07-14 04:04:27,563 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,563 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure '7175ea07-1865-bab9-dfe2-0c4877158581' locally completed 2023-07-14 04:04:27,563 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure '7175ea07-1865-bab9-dfe2-0c4877158581' completed for member 'jenkins-hbase4.apache.org,41323,1689307431507' in zk 2023-07-14 04:04:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure '7175ea07-1865-bab9-dfe2-0c4877158581' has notified controller of completion 2023-07-14 04:04:27,565 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 04:04:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 04:04:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 04:04:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,41323,1689307431507' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure '7175ea07-1865-bab9-dfe2-0c4877158581' completed. 2023-07-14 04:04:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 04:04:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 04:04:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 04:04:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure '7175ea07-1865-bab9-dfe2-0c4877158581' member 'jenkins-hbase4.apache.org,41323,1689307431507': 2023-07-14 04:04:27,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41323,1689307431507' released barrier for procedure'7175ea07-1865-bab9-dfe2-0c4877158581', counting down latch. Waiting for 0 more 2023-07-14 04:04:27,568 INFO [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure '7175ea07-1865-bab9-dfe2-0c4877158581' execution completed 2023-07-14 04:04:27,568 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 04:04:27,568 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 04:04:27,568 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,568 INFO [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure 7175ea07-1865-bab9-dfe2-0c4877158581including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 04:04:27,570 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,570 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,570 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 04:04:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 04:04:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 04:04:27,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 04:04:27,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 04:04:27,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 04:04:27,571 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 04:04:27,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,572 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 04:04:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,579 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,579 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,579 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 04:04:27,579 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 04:04:27,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 because node does not exist (not an error) 2023-07-14 04:04:27,580 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for 7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,580 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:27,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for 7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,580 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,580 DEBUG [(jenkins-hbase4.apache.org,37381,1689307430362)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 04:04:27,580 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 04:04:27,580 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 04:04:27,580 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 04:04:27,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 04:04:27,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:27,832 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 04:04:27,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } is done 2023-07-14 04:04:27,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(404): Snapshoting '{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 }' is still in progress! 2023-07-14 04:04:27,833 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 04:04:28,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp/7175ea07-1865-bab9-dfe2-0c4877158581 to hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:28,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot 7175ea07-1865-bab9-dfe2-0c4877158581 of table 8249d97d-3098-44b7-b98d-7a9fbec9db7c completed 2023-07-14 04:04:28,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:28,825 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/.hbase-snapshot/.tmp/7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:28,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot 7175ea07-1865-bab9-dfe2-0c4877158581 C_M_SNAPSHOT_TABLE on table 8249d97d-3098-44b7-b98d-7a9fbec9db7c at 1689307466726Consolidate snapshot: 7175ea07-1865-bab9-dfe2-0c4877158581 at 1689307467580 (+854 ms)Loading Region manifests for 7175ea07-1865-bab9-dfe2-0c4877158581 at 1689307467580Writing data manifest for 7175ea07-1865-bab9-dfe2-0c4877158581 at 1689307467585 (+5 ms)Verifying snapshot: 7175ea07-1865-bab9-dfe2-0c4877158581 at 1689307467995 (+410 ms)Snapshot 7175ea07-1865-bab9-dfe2-0c4877158581 of table 8249d97d-3098-44b7-b98d-7a9fbec9db7c completed at 1689307468824 (+829 ms) 2023-07-14 04:04:28,827 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=57, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=SHARED 2023-07-14 04:04:28,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=8249d97d-3098-44b7-b98d-7a9fbec9db7c, type=SHARED in 2.1000 sec 2023-07-14 04:04:28,833 DEBUG [Listener at localhost/42791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 04:04:28,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } is done 2023-07-14 04:04:28,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(401): Snapshot '{ ss=7175ea07-1865-bab9-dfe2-0c4877158581 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 04:04:28,834 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,834 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f652e17 to 127.0.0.1:50593 2023-07-14 04:04:28,834 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,835 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x1a323eae to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,839 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d8026e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,839 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:28,840 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40810, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=MasterService 2023-07-14 04:04:28,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1583): Client=rouser//172.31.14.131 snapshot request for:{ ss=6624045e-ffd0-6969-5cf9-d5046c2305c1 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } 2023-07-14 04:04:28,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689307468841 (current time:1689307468841). 2023-07-14 04:04:28,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 04:04:28,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x232c1968 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d30a51d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:28,845 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:28,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x232c1968 to 127.0.0.1:50593 2023-07-14 04:04:28,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x2ac81438 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@696cbf50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,852 DEBUG [hconnection-0x11cf72d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:28,853 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:28,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ac81438 to 127.0.0.1:50593 2023-07-14 04:04:28,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [owner: RWXCA] 2023-07-14 04:04:28,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rouser,f1: R] 2023-07-14 04:04:28,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rwuser,f1: RW] 2023-07-14 04:04:28,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 04:04:28,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c, params=[table=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c,],action=ADMIN) at org.apache.hadoop.hbase.security.access.AccessChecker.requirePermission(AccessChecker.java:273) at org.apache.hadoop.hbase.security.access.AccessController.requirePermission(AccessController.java:350) at org.apache.hadoop.hbase.security.access.AccessController.preSnapshot(AccessController.java:1027) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$75.call(MasterCoprocessorHost.java:1016) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$75.call(MasterCoprocessorHost.java:1013) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.master.MasterCoprocessorHost.preSnapshot(MasterCoprocessorHost.java:1013) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:641) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:587) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:28,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.CallRunner(144): callId: 1 service: MasterService methodName: Snapshot size: 102 connection: 172.31.14.131:40810 deadline: 1689307528841, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rouser, scope=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c, params=[table=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c,],action=ADMIN) 2023-07-14 04:04:28,857 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,858 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a323eae to 127.0.0.1:50593 2023-07-14 04:04:28,858 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,858 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x60308dfa to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,860 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@435f5c68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,861 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:28,862 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40820, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=MasterService 2023-07-14 04:04:28,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1583): Client=rwuser//172.31.14.131 snapshot request for:{ ss=6624045e-ffd0-6969-5cf9-d5046c2305c1 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } 2023-07-14 04:04:28,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689307468862 (current time:1689307468862). 2023-07-14 04:04:28,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 04:04:28,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x6877e5c7 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ee729ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:28,867 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:28,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6877e5c7 to 127.0.0.1:50593 2023-07-14 04:04:28,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x376d8d91 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60e30f66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,872 DEBUG [hconnection-0x371ce2cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:28,873 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:28,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x376d8d91 to 127.0.0.1:50593 2023-07-14 04:04:28,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [owner: RWXCA] 2023-07-14 04:04:28,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rouser,f1: R] 2023-07-14 04:04:28,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rwuser,f1: RW] 2023-07-14 04:04:28,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 04:04:28,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rwuser, scope=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c, params=[table=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c,],action=ADMIN) at org.apache.hadoop.hbase.security.access.AccessChecker.requirePermission(AccessChecker.java:273) at org.apache.hadoop.hbase.security.access.AccessController.requirePermission(AccessController.java:350) at org.apache.hadoop.hbase.security.access.AccessController.preSnapshot(AccessController.java:1027) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$75.call(MasterCoprocessorHost.java:1016) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$75.call(MasterCoprocessorHost.java:1013) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.master.MasterCoprocessorHost.preSnapshot(MasterCoprocessorHost.java:1013) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:641) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:587) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:28,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.CallRunner(144): callId: 1 service: MasterService methodName: Snapshot size: 102 connection: 172.31.14.131:40820 deadline: 1689307528862, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=rwuser, scope=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c, params=[table=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c,],action=ADMIN) 2023-07-14 04:04:28,877 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,877 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60308dfa to 127.0.0.1:50593 2023-07-14 04:04:28,877 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,877 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x4813dde3 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,880 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44a84535, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,881 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:28,882 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40824, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=MasterService 2023-07-14 04:04:28,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(1583): Client=usernone//172.31.14.131 snapshot request for:{ ss=6624045e-ffd0-6969-5cf9-d5046c2305c1 table=8249d97d-3098-44b7-b98d-7a9fbec9db7c type=FLUSH ttl=0 } 2023-07-14 04:04:28,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689307468882 (current time:1689307468882). 2023-07-14 04:04:28,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 04:04:28,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x7b8fbc88 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f1c5df3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:28,887 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:28,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b8fbc88 to 127.0.0.1:50593 2023-07-14 04:04:28,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(139): Connect 0x72e89ee4 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@740507cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,892 DEBUG [hconnection-0x199b2f7b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 04:04:28,892 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 04:04:28,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72e89ee4 to 127.0.0.1:50593 2023-07-14 04:04:28,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [owner: RWXCA] 2023-07-14 04:04:28,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rouser,f1: R] 2023-07-14 04:04:28,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] access.PermissionStorage(611): Read acl: entry[8249d97d-3098-44b7-b98d-7a9fbec9db7c], kv [rwuser,f1: RW] 2023-07-14 04:04:28,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 04:04:28,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c, params=[table=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c,],action=ADMIN) at org.apache.hadoop.hbase.security.access.AccessChecker.requirePermission(AccessChecker.java:273) at org.apache.hadoop.hbase.security.access.AccessController.requirePermission(AccessController.java:350) at org.apache.hadoop.hbase.security.access.AccessController.preSnapshot(AccessController.java:1027) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$75.call(MasterCoprocessorHost.java:1016) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$75.call(MasterCoprocessorHost.java:1013) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.master.MasterCoprocessorHost.preSnapshot(MasterCoprocessorHost.java:1013) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:641) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:587) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:28,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.CallRunner(144): callId: 1 service: MasterService methodName: Snapshot size: 102 connection: 172.31.14.131:40824 deadline: 1689307528882, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=usernone, scope=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c, params=[table=default:8249d97d-3098-44b7-b98d-7a9fbec9db7c,],action=ADMIN) 2023-07-14 04:04:28,896 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,896 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4813dde3 to 127.0.0.1:50593 2023-07-14 04:04:28,896 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,905 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x73ea210d to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,908 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d098172, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,909 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:28,910 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40830, version=2.4.18-SNAPSHOT, sasl=false, ugi=rouser (auth:SIMPLE), service=MasterService 2023-07-14 04:04:28,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(751): Client=rouser//172.31.14.131 delete name: "7175ea07-1865-bab9-dfe2-0c4877158581" 2023-07-14 04:04:28,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rouser' (global, action=ADMIN) at org.apache.hadoop.hbase.security.access.AccessChecker.requireGlobalPermission(AccessChecker.java:152) at org.apache.hadoop.hbase.security.access.AccessChecker.requirePermission(AccessChecker.java:125) at org.apache.hadoop.hbase.security.access.AccessController.preDeleteSnapshot(AccessController.java:1087) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$84.call(MasterCoprocessorHost.java:1103) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$84.call(MasterCoprocessorHost.java:1100) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.master.MasterCoprocessorHost.preDeleteSnapshot(MasterCoprocessorHost.java:1100) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.deleteSnapshot(SnapshotManager.java:330) at org.apache.hadoop.hbase.master.MasterRpcServices.deleteSnapshot(MasterRpcServices.java:752) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:28,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.CallRunner(144): callId: 1 service: MasterService methodName: DeleteSnapshot size: 68 connection: 172.31.14.131:40830 deadline: 1689307528913, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rouser' (global, action=ADMIN) 2023-07-14 04:04:28,917 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,917 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73ea210d to 127.0.0.1:50593 2023-07-14 04:04:28,917 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,917 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x283e6cc0 to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,921 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@142ba1da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,922 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:28,923 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40832, version=2.4.18-SNAPSHOT, sasl=false, ugi=rwuser (auth:SIMPLE), service=MasterService 2023-07-14 04:04:28,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(751): Client=rwuser//172.31.14.131 delete name: "7175ea07-1865-bab9-dfe2-0c4877158581" 2023-07-14 04:04:28,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rwuser' (global, action=ADMIN) at org.apache.hadoop.hbase.security.access.AccessChecker.requireGlobalPermission(AccessChecker.java:152) at org.apache.hadoop.hbase.security.access.AccessChecker.requirePermission(AccessChecker.java:125) at org.apache.hadoop.hbase.security.access.AccessController.preDeleteSnapshot(AccessController.java:1087) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$84.call(MasterCoprocessorHost.java:1103) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$84.call(MasterCoprocessorHost.java:1100) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.master.MasterCoprocessorHost.preDeleteSnapshot(MasterCoprocessorHost.java:1100) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.deleteSnapshot(SnapshotManager.java:330) at org.apache.hadoop.hbase.master.MasterRpcServices.deleteSnapshot(MasterRpcServices.java:752) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:28,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.CallRunner(144): callId: 1 service: MasterService methodName: DeleteSnapshot size: 68 connection: 172.31.14.131:40832 deadline: 1689307528923, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'rwuser' (global, action=ADMIN) 2023-07-14 04:04:28,927 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,927 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x283e6cc0 to 127.0.0.1:50593 2023-07-14 04:04:28,927 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,927 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x557e282c to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,930 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ca0e7e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,931 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:28,932 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40842, version=2.4.18-SNAPSHOT, sasl=false, ugi=usernone (auth:SIMPLE), service=MasterService 2023-07-14 04:04:28,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(751): Client=usernone//172.31.14.131 delete name: "7175ea07-1865-bab9-dfe2-0c4877158581" 2023-07-14 04:04:28,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (global, action=ADMIN) at org.apache.hadoop.hbase.security.access.AccessChecker.requireGlobalPermission(AccessChecker.java:152) at org.apache.hadoop.hbase.security.access.AccessChecker.requirePermission(AccessChecker.java:125) at org.apache.hadoop.hbase.security.access.AccessController.preDeleteSnapshot(AccessController.java:1087) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$84.call(MasterCoprocessorHost.java:1103) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$84.call(MasterCoprocessorHost.java:1100) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.master.MasterCoprocessorHost.preDeleteSnapshot(MasterCoprocessorHost.java:1100) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.deleteSnapshot(SnapshotManager.java:330) at org.apache.hadoop.hbase.master.MasterRpcServices.deleteSnapshot(MasterRpcServices.java:752) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 04:04:28,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] ipc.CallRunner(144): callId: 1 service: MasterService methodName: DeleteSnapshot size: 68 connection: 172.31.14.131:40842 deadline: 1689307528932, exception=org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'usernone' (global, action=ADMIN) 2023-07-14 04:04:28,935 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,936 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x557e282c to 127.0.0.1:50593 2023-07-14 04:04:28,936 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,936 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(139): Connect 0x2723ccdf to 127.0.0.1:50593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 04:04:28,940 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ecf9c90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 04:04:28,940 DEBUG [Listener at localhost/42791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 04:04:28,941 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40852, version=2.4.18-SNAPSHOT, sasl=false, ugi=owner (auth:SIMPLE), service=MasterService 2023-07-14 04:04:28,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] master.MasterRpcServices(751): Client=owner//172.31.14.131 delete name: "7175ea07-1865-bab9-dfe2-0c4877158581" 2023-07-14 04:04:28,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37381] snapshot.SnapshotManager(333): Deleting snapshot: 7175ea07-1865-bab9-dfe2-0c4877158581 2023-07-14 04:04:28,947 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,947 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2723ccdf to 127.0.0.1:50593 2023-07-14 04:04:28,947 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,965 INFO [Listener at localhost/42791] hbase.ResourceChecker(175): after: client.TestSnapshotWithAclAsyncAdmin#testDeleteSnapshot Thread=273 (was 258) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x2ac81438-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x376d8d91 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x73ea210d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x557e282c java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1370051818_17 at /127.0.0.1:58146 [Waiting for operation #28] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1370051818_17 at /127.0.0.1:45384 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x2ac81438 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x2723ccdf-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x60308dfa java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x2723ccdf-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4813dde3-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x7b8fbc88-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x73ea210d java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1e8a3e-shared-pool-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x6877e5c7 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x232c1968 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x283e6cc0-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x7b8fbc88-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4813dde3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x1a323eae-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x2723ccdf java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x7b8fbc88 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x557e282c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x376d8d91-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x557e282c-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: hconnection-0x12bb43db-shared-pool-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x72e89ee4-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x60308dfa-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x60308dfa-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x2ac81438-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x73ea210d-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x72e89ee4-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x232c1968-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x6877e5c7-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x283e6cc0-SendThread(127.0.0.1:50593) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:228) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x72e89ee4 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x1a323eae java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x376d8d91-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x4813dde3 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x1a323eae-SendThread(127.0.0.1:50593) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1261) Potentially hanging thread: hconnection-0x12bb43db-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x283e6cc0 java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1257) java.lang.Thread.join(Thread.java:1331) org.apache.zookeeper.ClientCnxn.disconnect(ClientCnxn.java:1455) org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1485) org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:1415) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.closeZk(ReadOnlyZKClient.java:304) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:352) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1892792484.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x232c1968-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50593@0x6877e5c7-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) - Thread LEAK? -, OpenFileDescriptor=543 (was 525) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=104 (was 113), ProcessCount=170 (was 170), AvailableMemoryMB=6487 (was 6495) 2023-07-14 04:04:28,966 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 04:04:28,966 INFO [Listener at localhost/42791] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 04:04:28,966 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x344cf7e4 to 127.0.0.1:50593 2023-07-14 04:04:28,966 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,966 DEBUG [Listener at localhost/42791] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 04:04:28,967 DEBUG [Listener at localhost/42791] util.JVMClusterUtil(257): Found active master hash=1932187511, stopped=false 2023-07-14 04:04:28,967 DEBUG [Listener at localhost/42791] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:28,967 DEBUG [Listener at localhost/42791] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:28,967 DEBUG [Listener at localhost/42791] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 04:04:28,967 INFO [Listener at localhost/42791] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:04:28,969 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 04:04:28,969 INFO [Listener at localhost/42791] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 04:04:28,969 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:04:28,969 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 04:04:28,969 DEBUG [Listener at localhost/42791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x714123e5 to 127.0.0.1:50593 2023-07-14 04:04:28,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 04:04:28,969 DEBUG [Listener at localhost/42791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 04:04:28,970 INFO [Listener at localhost/42791] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41323,1689307431507' ***** 2023-07-14 04:04:28,970 DEBUG [Listener at localhost/42791] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:28,970 INFO [Listener at localhost/42791] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 04:04:28,970 INFO [RS:0;jenkins-hbase4:41323] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 04:04:28,970 INFO [RS:0;jenkins-hbase4:41323] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 04:04:28,970 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 04:04:28,971 INFO [RS:0;jenkins-hbase4:41323] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 04:04:28,971 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for 36cb8b501ab4c7a9c4ed36010727c7fd 2023-07-14 04:04:28,971 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for 0f2eea6700e10bddc1ac7d4b1060ce90 2023-07-14 04:04:28,971 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for 41a51de638de0117d4dfe44d18aed927 2023-07-14 04:04:28,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36cb8b501ab4c7a9c4ed36010727c7fd, disabling compactions & flushes 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for 475da83a3b04248fcc83155226158a0c 2023-07-14 04:04:28,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:28,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for 1c4e06fb4ecdd3c332880d64437f3855 2023-07-14 04:04:28,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. after waiting 0 ms 2023-07-14 04:04:28,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for b80b4696e06939180eb5441824006cb5 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for 32a655f65cbf98a730e437788b0a521a 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for 1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:28,972 DEBUG [RS:0;jenkins-hbase4:41323] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18392234 to 127.0.0.1:50593 2023-07-14 04:04:28,972 DEBUG [RS:0;jenkins-hbase4:41323] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 04:04:28,972 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 04:04:28,973 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1474): Waiting on 11 regions to close 2023-07-14 04:04:28,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 04:04:28,973 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 04:04:28,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 04:04:28,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 04:04:28,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 04:04:28,974 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=24.56 KB heapSize=38.83 KB 2023-07-14 04:04:28,975 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 0f2eea6700e10bddc1ac7d4b1060ce90, 1588230740, 1c4e06fb4ecdd3c332880d64437f3855, 1d6e377eb8c5e4e300c0bbbc865ff89a, 32a655f65cbf98a730e437788b0a521a, 36cb8b501ab4c7a9c4ed36010727c7fd, 41a51de638de0117d4dfe44d18aed927, 475da83a3b04248fcc83155226158a0c, b80b4696e06939180eb5441824006cb5, b8c757dd8faaa8b52119b6b735fe8d24, ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:28,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/36cb8b501ab4c7a9c4ed36010727c7fd/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-14 04:04:28,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:28,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:28,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36cb8b501ab4c7a9c4ed36010727c7fd: 2023-07-14 04:04:28,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed 21c62941-a65c-d243-9db6-4c9e6ea96601,s,1689307436754.36cb8b501ab4c7a9c4ed36010727c7fd. 2023-07-14 04:04:28,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f2eea6700e10bddc1ac7d4b1060ce90, disabling compactions & flushes 2023-07-14 04:04:28,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:28,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:28,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. after waiting 0 ms 2023-07-14 04:04:28,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:28,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0f2eea6700e10bddc1ac7d4b1060ce90 1/1 column families, dataSize=64 B heapSize=464 B 2023-07-14 04:04:28,988 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 04:04:29,030 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'fb8fce90-ed2c-98d2-b8ee-9608d264d688' 2023-07-14 04:04:29,031 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table '8249d97d-3098-44b7-b98d-7a9fbec9db7c' 2023-07-14 04:04:29,121 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 04:04:29,121 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 04:04:29,175 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 0f2eea6700e10bddc1ac7d4b1060ce90, 1588230740, 1c4e06fb4ecdd3c332880d64437f3855, 1d6e377eb8c5e4e300c0bbbc865ff89a, 32a655f65cbf98a730e437788b0a521a, 41a51de638de0117d4dfe44d18aed927, 475da83a3b04248fcc83155226158a0c, b80b4696e06939180eb5441824006cb5, b8c757dd8faaa8b52119b6b735fe8d24, ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:29,375 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 0f2eea6700e10bddc1ac7d4b1060ce90, 1588230740, 1c4e06fb4ecdd3c332880d64437f3855, 1d6e377eb8c5e4e300c0bbbc865ff89a, 32a655f65cbf98a730e437788b0a521a, 41a51de638de0117d4dfe44d18aed927, 475da83a3b04248fcc83155226158a0c, b80b4696e06939180eb5441824006cb5, b8c757dd8faaa8b52119b6b735fe8d24, ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:29,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=23.32 KB at sequenceid=70 (bloomFilter=false), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/.tmp/info/43da130f22b54370b311a7f185c0e7d8 2023-07-14 04:04:29,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64 B at sequenceid=30011 (bloomFilter=true), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/.tmp/f1/34f2754381e74cf9932ace52c407af7f 2023-07-14 04:04:29,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43da130f22b54370b311a7f185c0e7d8 2023-07-14 04:04:29,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/.tmp/f1/34f2754381e74cf9932ace52c407af7f as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/f1/34f2754381e74cf9932ace52c407af7f 2023-07-14 04:04:29,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/f1/34f2754381e74cf9932ace52c407af7f, entries=2, sequenceid=30011, filesize=4.8 K 2023-07-14 04:04:29,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~64 B/64, heapSize ~448 B/448, currentSize=0 B/0 for 0f2eea6700e10bddc1ac7d4b1060ce90 in 431ms, sequenceid=30011, compaction requested=false 2023-07-14 04:04:29,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/0f2eea6700e10bddc1ac7d4b1060ce90/recovered.edits/30014.seqid, newMaxSeqId=30014, maxSeqId=30006 2023-07-14 04:04:29,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:29,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:29,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f2eea6700e10bddc1ac7d4b1060ce90: 2023-07-14 04:04:29,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,,1689307436754.0f2eea6700e10bddc1ac7d4b1060ce90. 2023-07-14 04:04:29,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41a51de638de0117d4dfe44d18aed927, disabling compactions & flushes 2023-07-14 04:04:29,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:29,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:29,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. after waiting 0 ms 2023-07-14 04:04:29,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:29,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf/41a51de638de0117d4dfe44d18aed927/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-14 04:04:29,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:29,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:29,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41a51de638de0117d4dfe44d18aed927: 2023-07-14 04:04:29,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed 3a3f5dc6-f0f8-0fd9-e60c-7cdcc2e00bdf,s,1689307436754.41a51de638de0117d4dfe44d18aed927. 2023-07-14 04:04:29,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 475da83a3b04248fcc83155226158a0c, disabling compactions & flushes 2023-07-14 04:04:29,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:04:29,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:04:29,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. after waiting 0 ms 2023-07-14 04:04:29,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:04:29,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 475da83a3b04248fcc83155226158a0c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 04:04:29,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c/.tmp/info/efc1ad6536fb4cc292a8642c9025225e 2023-07-14 04:04:29,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c/.tmp/info/efc1ad6536fb4cc292a8642c9025225e as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c/info/efc1ad6536fb4cc292a8642c9025225e 2023-07-14 04:04:29,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c/info/efc1ad6536fb4cc292a8642c9025225e, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 04:04:29,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 475da83a3b04248fcc83155226158a0c in 22ms, sequenceid=6, compaction requested=false 2023-07-14 04:04:29,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/namespace/475da83a3b04248fcc83155226158a0c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 04:04:29,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:29,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:04:29,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 475da83a3b04248fcc83155226158a0c: 2023-07-14 04:04:29,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689307434433.475da83a3b04248fcc83155226158a0c. 2023-07-14 04:04:29,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c4e06fb4ecdd3c332880d64437f3855, disabling compactions & flushes 2023-07-14 04:04:29,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:29,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:29,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. after waiting 0 ms 2023-07-14 04:04:29,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:29,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1c4e06fb4ecdd3c332880d64437f3855 1/1 column families, dataSize=64 B heapSize=464 B 2023-07-14 04:04:29,576 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 1588230740, 1c4e06fb4ecdd3c332880d64437f3855, 1d6e377eb8c5e4e300c0bbbc865ff89a, 32a655f65cbf98a730e437788b0a521a, b80b4696e06939180eb5441824006cb5, b8c757dd8faaa8b52119b6b735fe8d24, ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:29,776 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 1588230740, 1c4e06fb4ecdd3c332880d64437f3855, 1d6e377eb8c5e4e300c0bbbc865ff89a, 32a655f65cbf98a730e437788b0a521a, b80b4696e06939180eb5441824006cb5, b8c757dd8faaa8b52119b6b735fe8d24, ed1e85127c4d73d8edec872fdc80d2ed 2023-07-14 04:04:29,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.23 KB at sequenceid=70 (bloomFilter=false), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/.tmp/table/96db6665df6d4d688e6a914dce8ed7dd 2023-07-14 04:04:29,817 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/.tmp/info/43da130f22b54370b311a7f185c0e7d8 as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/info/43da130f22b54370b311a7f185c0e7d8 2023-07-14 04:04:29,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43da130f22b54370b311a7f185c0e7d8 2023-07-14 04:04:29,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/info/43da130f22b54370b311a7f185c0e7d8, entries=104, sequenceid=70, filesize=19.6 K 2023-07-14 04:04:29,824 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/.tmp/table/96db6665df6d4d688e6a914dce8ed7dd as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/table/96db6665df6d4d688e6a914dce8ed7dd 2023-07-14 04:04:29,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/table/96db6665df6d4d688e6a914dce8ed7dd, entries=13, sequenceid=70, filesize=5.4 K 2023-07-14 04:04:29,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24.56 KB/25146, heapSize ~38.55 KB/39472, currentSize=0 B/0 for 1588230740 in 856ms, sequenceid=70, compaction requested=false 2023-07-14 04:04:29,835 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/meta/1588230740/recovered.edits/73.seqid, newMaxSeqId=73, maxSeqId=1 2023-07-14 04:04:29,836 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:29,836 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 04:04:29,836 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 04:04:29,836 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 04:04:29,836 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 04:04:29,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=64 B at sequenceid=30027 (bloomFilter=true), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/.tmp/f1/6f07a85aca5049e0ac2d76f3fa70ea4c 2023-07-14 04:04:29,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/.tmp/f1/6f07a85aca5049e0ac2d76f3fa70ea4c as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/6f07a85aca5049e0ac2d76f3fa70ea4c 2023-07-14 04:04:29,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/f1/6f07a85aca5049e0ac2d76f3fa70ea4c, entries=2, sequenceid=30027, filesize=4.8 K 2023-07-14 04:04:29,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~64 B/64, heapSize ~448 B/448, currentSize=0 B/0 for 1c4e06fb4ecdd3c332880d64437f3855 in 441ms, sequenceid=30027, compaction requested=false 2023-07-14 04:04:29,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/1c4e06fb4ecdd3c332880d64437f3855/recovered.edits/30030.seqid, newMaxSeqId=30030, maxSeqId=30022 2023-07-14 04:04:29,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:29,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:29,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c4e06fb4ecdd3c332880d64437f3855: 2023-07-14 04:04:29,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,,1689307436754.1c4e06fb4ecdd3c332880d64437f3855. 2023-07-14 04:04:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b80b4696e06939180eb5441824006cb5, disabling compactions & flushes 2023-07-14 04:04:29,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. after waiting 0 ms 2023-07-14 04:04:29,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:29,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b80b4696e06939180eb5441824006cb5/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=1 2023-07-14 04:04:29,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:29,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:29,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b80b4696e06939180eb5441824006cb5: 2023-07-14 04:04:29,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed 8249d97d-3098-44b7-b98d-7a9fbec9db7c,s,1689307464566.b80b4696e06939180eb5441824006cb5. 2023-07-14 04:04:29,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed1e85127c4d73d8edec872fdc80d2ed, disabling compactions & flushes 2023-07-14 04:04:29,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:29,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:29,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. after waiting 0 ms 2023-07-14 04:04:29,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/fb8fce90-ed2c-98d2-b8ee-9608d264d688/ed1e85127c4d73d8edec872fdc80d2ed/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=8 2023-07-14 04:04:29,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:29,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:29,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed1e85127c4d73d8edec872fdc80d2ed: 2023-07-14 04:04:29,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed fb8fce90-ed2c-98d2-b8ee-9608d264d688,s,1689307436754.ed1e85127c4d73d8edec872fdc80d2ed. 2023-07-14 04:04:29,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 32a655f65cbf98a730e437788b0a521a, disabling compactions & flushes 2023-07-14 04:04:29,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:04:29,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:04:29,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. after waiting 0 ms 2023-07-14 04:04:29,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:04:29,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 32a655f65cbf98a730e437788b0a521a 1/1 column families, dataSize=1008 B heapSize=2.36 KB 2023-07-14 04:04:29,976 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-14 04:04:29,976 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1478): Online Regions={32a655f65cbf98a730e437788b0a521a=hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a., b8c757dd8faaa8b52119b6b735fe8d24=8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24., 1d6e377eb8c5e4e300c0bbbc865ff89a=21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a.} 2023-07-14 04:04:29,976 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 1d6e377eb8c5e4e300c0bbbc865ff89a, 32a655f65cbf98a730e437788b0a521a, b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:30,177 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 1d6e377eb8c5e4e300c0bbbc865ff89a, 32a655f65cbf98a730e437788b0a521a, b8c757dd8faaa8b52119b6b735fe8d24 2023-07-14 04:04:30,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1008 B at sequenceid=19 (bloomFilter=false), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a/.tmp/l/52f009ed72a843a2a0b4e75648dcb6aa 2023-07-14 04:04:30,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a/.tmp/l/52f009ed72a843a2a0b4e75648dcb6aa as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a/l/52f009ed72a843a2a0b4e75648dcb6aa 2023-07-14 04:04:30,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a/l/52f009ed72a843a2a0b4e75648dcb6aa, entries=11, sequenceid=19, filesize=5.3 K 2023-07-14 04:04:30,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1008 B/1008, heapSize ~2.34 KB/2400, currentSize=0 B/0 for 32a655f65cbf98a730e437788b0a521a in 420ms, sequenceid=19, compaction requested=false 2023-07-14 04:04:30,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/hbase/acl/32a655f65cbf98a730e437788b0a521a/recovered.edits/22.seqid, newMaxSeqId=22, maxSeqId=1 2023-07-14 04:04:30,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:30,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:04:30,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 32a655f65cbf98a730e437788b0a521a: 2023-07-14 04:04:30,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689307435863.32a655f65cbf98a730e437788b0a521a. 2023-07-14 04:04:30,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b8c757dd8faaa8b52119b6b735fe8d24, disabling compactions & flushes 2023-07-14 04:04:30,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:30,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:30,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. after waiting 0 ms 2023-07-14 04:04:30,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:30,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/8249d97d-3098-44b7-b98d-7a9fbec9db7c/b8c757dd8faaa8b52119b6b735fe8d24/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=1 2023-07-14 04:04:30,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:30,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:30,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b8c757dd8faaa8b52119b6b735fe8d24: 2023-07-14 04:04:30,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed 8249d97d-3098-44b7-b98d-7a9fbec9db7c,,1689307464566.b8c757dd8faaa8b52119b6b735fe8d24. 2023-07-14 04:04:30,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1d6e377eb8c5e4e300c0bbbc865ff89a, disabling compactions & flushes 2023-07-14 04:04:30,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:30,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:30,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. after waiting 0 ms 2023-07-14 04:04:30,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:30,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1d6e377eb8c5e4e300c0bbbc865ff89a 1/1 column families, dataSize=32 B heapSize=360 B 2023-07-14 04:04:30,377 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:30,513 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:30,513 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 04:04:30,513 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:30,513 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 04:04:30,577 DEBUG [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1504): Waiting on 1d6e377eb8c5e4e300c0bbbc865ff89a 2023-07-14 04:04:30,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=32 B at sequenceid=30010 (bloomFilter=true), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/.tmp/f1/138935159451415ba1a1b6752887cbae 2023-07-14 04:04:30,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/.tmp/f1/138935159451415ba1a1b6752887cbae as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/f1/138935159451415ba1a1b6752887cbae 2023-07-14 04:04:30,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/f1/138935159451415ba1a1b6752887cbae, entries=1, sequenceid=30010, filesize=4.8 K 2023-07-14 04:04:30,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~32 B/32, heapSize ~344 B/344, currentSize=0 B/0 for 1d6e377eb8c5e4e300c0bbbc865ff89a in 421ms, sequenceid=30010, compaction requested=false 2023-07-14 04:04:30,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/data/default/21c62941-a65c-d243-9db6-4c9e6ea96601/1d6e377eb8c5e4e300c0bbbc865ff89a/recovered.edits/30013.seqid, newMaxSeqId=30013, maxSeqId=30006 2023-07-14 04:04:30,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 04:04:30,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:30,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1d6e377eb8c5e4e300c0bbbc865ff89a: 2023-07-14 04:04:30,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed 21c62941-a65c-d243-9db6-4c9e6ea96601,,1689307436754.1d6e377eb8c5e4e300c0bbbc865ff89a. 2023-07-14 04:04:30,777 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41323,1689307431507; all regions closed. 2023-07-14 04:04:30,785 DEBUG [RS:0;jenkins-hbase4:41323] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/oldWALs 2023-07-14 04:04:30,785 INFO [RS:0;jenkins-hbase4:41323] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41323%2C1689307431507.meta:.meta(num 1689307434195) 2023-07-14 04:04:30,787 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/WALs/jenkins-hbase4.apache.org,41323,1689307431507/jenkins-hbase4.apache.org%2C41323%2C1689307431507.1689307433209 not finished, retry = 0 2023-07-14 04:04:30,890 DEBUG [RS:0;jenkins-hbase4:41323] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/oldWALs 2023-07-14 04:04:30,891 INFO [RS:0;jenkins-hbase4:41323] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41323%2C1689307431507:(num 1689307433209) 2023-07-14 04:04:30,891 DEBUG [RS:0;jenkins-hbase4:41323] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:30,891 INFO [RS:0;jenkins-hbase4:41323] regionserver.LeaseManager(133): Closed leases 2023-07-14 04:04:30,891 INFO [RS:0;jenkins-hbase4:41323] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 04:04:30,891 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 04:04:30,892 INFO [RS:0;jenkins-hbase4:41323] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41323 2023-07-14 04:04:30,898 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41323,1689307431507 2023-07-14 04:04:30,898 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 04:04:30,899 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 04:04:30,900 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41323,1689307431507] 2023-07-14 04:04:30,900 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41323,1689307431507; numProcessing=1 2023-07-14 04:04:30,901 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41323,1689307431507 already deleted, retry=false 2023-07-14 04:04:30,901 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41323,1689307431507 expired; onlineServers=0 2023-07-14 04:04:30,901 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37381,1689307430362' ***** 2023-07-14 04:04:30,901 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 04:04:30,902 DEBUG [M:0;jenkins-hbase4:37381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3217dd4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-14 04:04:30,902 INFO [M:0;jenkins-hbase4:37381] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37381,1689307430362 2023-07-14 04:04:30,902 INFO [M:0;jenkins-hbase4:37381] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37381,1689307430362; all regions closed. 2023-07-14 04:04:30,902 DEBUG [M:0;jenkins-hbase4:37381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 04:04:30,902 DEBUG [M:0;jenkins-hbase4:37381] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 04:04:30,902 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 04:04:30,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689307432933] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689307432933,5,FailOnTimeoutGroup] 2023-07-14 04:04:30,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689307432934] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689307432934,5,FailOnTimeoutGroup] 2023-07-14 04:04:30,902 DEBUG [M:0;jenkins-hbase4:37381] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 04:04:30,903 INFO [M:0;jenkins-hbase4:37381] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 04:04:30,903 INFO [M:0;jenkins-hbase4:37381] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 04:04:30,903 INFO [M:0;jenkins-hbase4:37381] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-14 04:04:30,903 DEBUG [M:0;jenkins-hbase4:37381] master.HMaster(1512): Stopping service threads 2023-07-14 04:04:30,903 INFO [M:0;jenkins-hbase4:37381] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 04:04:30,903 ERROR [M:0;jenkins-hbase4:37381] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] 2023-07-14 04:04:30,904 INFO [M:0;jenkins-hbase4:37381] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 04:04:30,904 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 04:04:30,904 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 04:04:30,904 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 04:04:30,904 DEBUG [M:0;jenkins-hbase4:37381] zookeeper.ZKUtil(398): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 04:04:30,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 04:04:30,905 WARN [M:0;jenkins-hbase4:37381] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 04:04:30,905 INFO [M:0;jenkins-hbase4:37381] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 04:04:30,905 INFO [M:0;jenkins-hbase4:37381] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 04:04:30,905 DEBUG [M:0;jenkins-hbase4:37381] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 04:04:30,905 INFO [M:0;jenkins-hbase4:37381] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 04:04:30,905 DEBUG [M:0;jenkins-hbase4:37381] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 04:04:30,905 DEBUG [M:0;jenkins-hbase4:37381] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 04:04:30,905 DEBUG [M:0;jenkins-hbase4:37381] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 04:04:30,905 INFO [M:0;jenkins-hbase4:37381] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=212.33 KB heapSize=252.09 KB 2023-07-14 04:04:31,000 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 04:04:31,000 INFO [RS:0;jenkins-hbase4:41323] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41323,1689307431507; zookeeper connection closed. 2023-07-14 04:04:31,001 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): regionserver:41323-0x10162003da40001, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 04:04:31,001 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18ee8f2f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18ee8f2f 2023-07-14 04:04:31,001 INFO [Listener at localhost/42791] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-14 04:04:31,315 INFO [M:0;jenkins-hbase4:37381] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=212.33 KB at sequenceid=460 (bloomFilter=true), to=hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b41ff19aa1644ac3baa71ea597530184 2023-07-14 04:04:31,321 INFO [M:0;jenkins-hbase4:37381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b41ff19aa1644ac3baa71ea597530184 2023-07-14 04:04:31,322 DEBUG [M:0;jenkins-hbase4:37381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b41ff19aa1644ac3baa71ea597530184 as hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b41ff19aa1644ac3baa71ea597530184 2023-07-14 04:04:31,328 INFO [M:0;jenkins-hbase4:37381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b41ff19aa1644ac3baa71ea597530184 2023-07-14 04:04:31,328 INFO [M:0;jenkins-hbase4:37381] regionserver.HStore(1080): Added hdfs://localhost:37843/user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b41ff19aa1644ac3baa71ea597530184, entries=57, sequenceid=460, filesize=15.9 K 2023-07-14 04:04:31,329 INFO [M:0;jenkins-hbase4:37381] regionserver.HRegion(2948): Finished flush of dataSize ~212.33 KB/217430, heapSize ~252.08 KB/258128, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 424ms, sequenceid=460, compaction requested=false 2023-07-14 04:04:31,330 INFO [M:0;jenkins-hbase4:37381] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 04:04:31,330 DEBUG [M:0;jenkins-hbase4:37381] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 04:04:31,332 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/825224ef-797c-20b7-cd84-73d7414cd7eb/MasterData/WALs/jenkins-hbase4.apache.org,37381,1689307430362/jenkins-hbase4.apache.org%2C37381%2C1689307430362.1689307432327 not finished, retry = 0 2023-07-14 04:04:31,434 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 04:04:31,434 INFO [M:0;jenkins-hbase4:37381] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 04:04:31,434 INFO [M:0;jenkins-hbase4:37381] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37381 2023-07-14 04:04:31,436 DEBUG [M:0;jenkins-hbase4:37381] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37381,1689307430362 already deleted, retry=false 2023-07-14 04:04:31,539 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 04:04:31,539 INFO [M:0;jenkins-hbase4:37381] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37381,1689307430362; zookeeper connection closed. 2023-07-14 04:04:31,539 DEBUG [Listener at localhost/42791-EventThread] zookeeper.ZKWatcher(600): master:37381-0x10162003da40000, quorum=127.0.0.1:50593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 04:04:31,541 WARN [Listener at localhost/42791] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 04:04:31,544 INFO [Listener at localhost/42791] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 04:04:31,647 WARN [BP-1039997702-172.31.14.131-1689307427473 heartbeating to localhost/127.0.0.1:37843] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 04:04:31,647 WARN [BP-1039997702-172.31.14.131-1689307427473 heartbeating to localhost/127.0.0.1:37843] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1039997702-172.31.14.131-1689307427473 (Datanode Uuid b9309c1a-68c3-472c-aece-dda1be795ec4) service to localhost/127.0.0.1:37843 2023-07-14 04:04:31,648 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/cluster_b593e329-f19a-8822-21e5-4d9c97e93cbb/dfs/data/data1/current/BP-1039997702-172.31.14.131-1689307427473] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 04:04:31,649 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f81b51f6-0fee-2586-60f5-e1f05b4ed415/cluster_b593e329-f19a-8822-21e5-4d9c97e93cbb/dfs/data/data2/current/BP-1039997702-172.31.14.131-1689307427473] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 04:04:31,668 INFO [Listener at localhost/42791] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 04:04:31,779 INFO [Listener at localhost/42791] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 04:04:31,804 INFO [Listener at localhost/42791] hbase.HBaseTestingUtility(1293): Minicluster is down